Aug 26 14:35:43 user nova-compute[73052]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 14:35:46 user nova-compute[73052]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73052) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 14:35:46 user nova-compute[73052]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73052) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 14:35:46 user nova-compute[73052]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73052) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 14:35:46 user nova-compute[73052]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 14:35:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:35:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:35:46 user nova-compute[73052]: INFO nova.virt.driver [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 14:35:47 user nova-compute[73052]: INFO nova.compute.provider_config [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] Acquiring lock "singleton_lock" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] Acquired lock "singleton_lock" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] Releasing lock "singleton_lock" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] Full set of CONF: {{(pid=73052) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ******************************************************************************** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] Configuration options gathered from: {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ================================================================================ {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] allow_resize_to_same_host      = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] arq_binding_timeout            = 300 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] backdoor_port                  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] backdoor_socket                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] block_device_allocate_retries  = 300 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] block_device_allocate_retries_interval = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cert                           = self.pem {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute_monitors               = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] config_dir                     = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] config_drive_format            = iso9660 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] config_source                  = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] console_host                   = user {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] control_exchange               = nova {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cpu_allocation_ratio           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] daemon                         = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] debug                          = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] default_access_ip_network_name = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] default_availability_zone      = nova {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] default_ephemeral_format       = ext4 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] default_green_pool_size        = 1000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] default_schedule_zone          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] disk_allocation_ratio          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] enable_new_services            = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] enabled_ssl_apis               = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] flat_injected                  = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] force_config_drive             = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] force_raw_images               = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] graceful_shutdown_timeout      = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] heal_instance_info_cache_interval = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] host                           = user {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] instance_build_timeout         = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] instance_delete_interval       = 300 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] instance_name_template         = instance-%08x {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] instance_usage_audit           = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] instance_usage_audit_period    = month {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] internal_service_availability_zone = internal {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] key                            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] live_migration_retry_count     = 30 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] log_config_append              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] log_dir                        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] log_file                       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] log_options                    = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] log_rotate_interval            = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] log_rotate_interval_type       = days {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] log_rotation_type              = none {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] long_rpc_timeout               = 1800 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] max_concurrent_builds          = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] max_concurrent_live_migrations = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] max_concurrent_snapshots       = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] max_local_block_devices        = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] max_logfile_count              = 30 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] max_logfile_size_mb            = 200 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] maximum_instance_delete_attempts = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] metadata_listen                = 0.0.0.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] metadata_listen_port           = 8775 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] metadata_workers               = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] migrate_max_retries            = -1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] mkisofs_cmd                    = genisoimage {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] my_ip                          = 10.0.0.210 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] network_allocate_retries       = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] osapi_compute_listen_port      = 8774 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] osapi_compute_unique_server_name_scope =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] osapi_compute_workers          = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] password_length                = 12 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] periodic_enable                = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] periodic_fuzzy_delay           = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] pointer_model                  = ps2mouse {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] preallocate_images             = none {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] publish_errors                 = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] pybasedir                      = /opt/stack/nova {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ram_allocation_ratio           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] rate_limit_burst               = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] rate_limit_except_level        = CRITICAL {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] rate_limit_interval            = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] reboot_timeout                 = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] reclaim_instance_interval      = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] record                         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] reimage_timeout_per_gb         = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] report_interval                = 120 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] rescue_timeout                 = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] reserved_host_cpus             = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] reserved_host_disk_mb          = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] reserved_host_memory_mb        = 512 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] reserved_huge_pages            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] resize_confirm_window          = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] resize_fs_using_block_device   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] resume_guests_state_on_host_boot = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] rpc_response_timeout           = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] run_external_periodic_tasks    = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] running_deleted_instance_action = reap {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] running_deleted_instance_timeout = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler_instance_sync_interval = 120 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_down_time              = 720 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] servicegroup_driver            = db {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] shelved_offload_time           = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] shelved_poll_interval          = 3600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] shutdown_timeout               = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] source_is_ipv6                 = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ssl_only                       = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] state_path                     = /opt/stack/data/nova {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] sync_power_state_interval      = 600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] sync_power_state_pool_size     = 1000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] syslog_log_facility            = LOG_USER {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] tempdir                        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] timeout_nbd                    = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] transport_url                  = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] update_resources_interval      = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] use_cow_images                 = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] use_eventlog                   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] use_journal                    = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] use_json                       = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] use_rootwrap_daemon            = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] use_stderr                     = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] use_syslog                     = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vcpu_pin_set                   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plugging_is_fatal          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plugging_timeout           = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] virt_mkfs                      = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] volume_usage_poll_interval     = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] watch_log_file                 = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] web                            = /usr/share/spice-html5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_concurrency.disable_process_locking = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.auth_strategy              = keystone {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.compute_link_prefix        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.dhcp_domain                = novalocal {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.enable_instance_password   = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.glance_link_prefix         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.instance_list_per_project_cells = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.list_records_by_skipping_down_cells = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.local_metadata_per_cell    = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.max_limit                  = 1000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.metadata_cache_expiration  = 15 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.neutron_default_tenant_id  = default {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.use_forwarded_for          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.use_neutron_default_nets   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.vendordata_dynamic_targets = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.vendordata_jsonfile_path   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.backend_argument         = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.config_prefix            = cache.oslo {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.dead_timeout             = 60.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.debug_cache_backend      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.enable_retry_client      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.enable_socket_keepalive  = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.enabled                  = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.expiration_time          = 600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.hashclient_retry_attempts = 2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_dead_retry      = 300 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_password        =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_sasl_enabled    = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.memcache_username        =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.proxies                  = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.retry_attempts           = 2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.retry_delay              = 0.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.socket_keepalive_count   = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.socket_keepalive_idle    = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.socket_keepalive_interval = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.tls_allowed_ciphers      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.tls_cafile               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.tls_certfile             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.tls_enabled              = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cache.tls_keyfile              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.auth_section            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.auth_type               = password {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.cafile                  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.certfile                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.collect_timing          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.cross_az_attach         = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.debug                   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.endpoint_template       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.http_retries            = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.insecure                = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.keyfile                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.os_region_name          = RegionOne {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.split_loggers           = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cinder.timeout                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.cpu_dedicated_set      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.cpu_shared_set         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.image_type_exclude_list = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.resource_provider_association_refresh = 300 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.shutdown_retry_interval = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] conductor.workers              = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] console.allowed_origins        = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] console.ssl_ciphers            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] console.ssl_minimum_version    = default {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] consoleauth.token_ttl          = 600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.cafile                  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.certfile                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.collect_timing          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.connect_retries         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.connect_retry_delay     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.endpoint_override       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.insecure                = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.keyfile                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.max_version             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.min_version             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.region_name             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.service_name            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.service_type            = accelerator {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.split_loggers           = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.status_code_retries     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.status_code_retry_delay = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.timeout                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] cyborg.version                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.backend               = sqlalchemy {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.connection            = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.connection_debug      = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.connection_parameters =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.connection_recycle_time = 3600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.connection_trace      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.db_inc_retry_interval = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.db_max_retries        = 20 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.db_max_retry_interval = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.db_retry_interval     = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.max_overflow          = 50 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.max_pool_size         = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.max_retries           = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.mysql_enable_ndb      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.mysql_wsrep_sync_wait = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.pool_timeout          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.retry_interval        = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.slave_connection      = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] database.sqlite_synchronous    = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.backend           = sqlalchemy {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.connection        = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.connection_debug  = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.connection_parameters =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.connection_recycle_time = 3600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.connection_trace  = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.db_inc_retry_interval = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.db_max_retries    = 20 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.db_max_retry_interval = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.db_retry_interval = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.max_overflow      = 50 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.max_pool_size     = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.max_retries       = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.mysql_enable_ndb  = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.pool_timeout      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.retry_interval    = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.slave_connection  = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] api_database.sqlite_synchronous = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] devices.enabled_mdev_types     = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ephemeral_storage_encryption.enabled = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.api_servers             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.cafile                  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.certfile                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.collect_timing          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.connect_retries         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.connect_retry_delay     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.debug                   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.default_trusted_certificate_ids = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.enable_certificate_validation = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.enable_rbd_download     = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.endpoint_override       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.insecure                = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.keyfile                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.max_version             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.min_version             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.num_retries             = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.rbd_ceph_conf           =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.rbd_connect_timeout     = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.rbd_pool                =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.rbd_user                =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.region_name             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.service_name            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.service_type            = image {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.split_loggers           = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.status_code_retries     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.status_code_retry_delay = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.timeout                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.verify_glance_signatures = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] glance.version                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] guestfs.debug                  = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.config_drive_cdrom      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.config_drive_inject_password = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.enable_remotefx         = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.instances_path_share    =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.limit_cpu_features      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.use_multipath_io        = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.vswitch_name            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] mks.enabled                    = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] image_cache.manager_interval   = 2400 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] image_cache.precache_concurrency = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] image_cache.remove_unused_base_images = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] image_cache.subdirectory_name  = _base {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.api_max_retries         = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.api_retry_interval      = 2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.auth_section            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.auth_type               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.cafile                  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.certfile                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.collect_timing          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.connect_retries         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.connect_retry_delay     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.endpoint_override       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.insecure                = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.keyfile                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.max_version             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.min_version             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.partition_key           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.peer_list               = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.region_name             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.serial_console_state_timeout = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.service_name            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.service_type            = baremetal {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.split_loggers           = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.status_code_retries     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.status_code_retry_delay = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.timeout                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ironic.version                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] key_manager.fixed_key          = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.barbican_api_version  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.barbican_endpoint     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.barbican_endpoint_type = public {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.barbican_region_name  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.cafile                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.certfile              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.collect_timing        = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.insecure              = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.keyfile               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.number_of_retries     = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.retry_delay           = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.send_service_user_token = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.split_loggers         = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.timeout               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.verify_ssl            = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican.verify_ssl_path       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.auth_section = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.auth_type = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.cafile   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.certfile = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.collect_timing = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.insecure = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.keyfile  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.split_loggers = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] barbican_service_user.timeout  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.approle_role_id          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.approle_secret_id        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.cafile                   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.certfile                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.collect_timing           = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.insecure                 = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.keyfile                  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.kv_mountpoint            = secret {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.kv_version               = 2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.namespace                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.root_token_id            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.split_loggers            = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.ssl_ca_crt_file          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.timeout                  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.use_ssl                  = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.cafile                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.certfile              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.collect_timing        = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.connect_retries       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.connect_retry_delay   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.endpoint_override     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.insecure              = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.keyfile               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.max_version           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.min_version           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.region_name           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.service_name          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.service_type          = identity {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.split_loggers         = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.status_code_retries   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.status_code_retry_delay = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.timeout               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] keystone.version               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.connection_uri         =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.cpu_mode               = custom {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: WARNING oslo_config.cfg [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.cpu_power_governor_high = performance {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.cpu_power_management   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.device_detach_attempts = 8 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.device_detach_timeout  = 20 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.disk_cachemodes        = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.disk_prefix            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.enabled_perf_events    = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.file_backed_memory     = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.gid_maps               = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.hw_disk_discard        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.hw_machine_type        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.images_rbd_pool        = rbd {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.images_type            = default {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.images_volume_group    = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.inject_key             = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.inject_partition       = -2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.inject_password        = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.iscsi_iface            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.iser_use_multipath     = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_downtime = 500 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_inbound_addr = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_scheme  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_timeout_action = abort {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_tunnelled = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: WARNING oslo_config.cfg [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 14:35:47 user nova-compute[73052]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 14:35:47 user nova-compute[73052]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 14:35:47 user nova-compute[73052]: and ``live_migration_inbound_addr`` respectively.
Aug 26 14:35:47 user nova-compute[73052]: ).  Its value may be silently ignored in the future.
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.live_migration_with_native_tls = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.max_queues             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.nfs_mount_options      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.num_pcie_ports         = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.pmem_namespaces        = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.quobyte_client_cfg     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rbd_secret_uuid        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rbd_user               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rescue_image_id        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rescue_kernel_id       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.rx_queue_size          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.smbfs_mount_options    =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.snapshot_compression   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.snapshot_image_format  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.sparse_logical_volumes = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.swtpm_enabled          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.swtpm_group            = tss {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.swtpm_user             = tss {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.sysinfo_serial         = unique {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.tb_cache_size          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.tx_queue_size          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.uid_maps               = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.use_virtio_for_bridges = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.virt_type              = kvm {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.volume_clear           = zero {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.volume_clear_size      = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.volume_use_multipath   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.vzstorage_cache_path   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.auth_section           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.auth_type              = password {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.cafile                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.certfile               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.collect_timing         = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.connect_retries        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.connect_retry_delay    = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.default_floating_pool  = public {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.endpoint_override      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.extension_sync_interval = 600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.http_retries           = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.insecure               = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.keyfile                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.max_version            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.min_version            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.ovs_bridge             = br-int {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.physnets               = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.region_name            = RegionOne {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.service_metadata_proxy = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.service_name           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.service_type           = network {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.split_loggers          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.status_code_retries    = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.status_code_retry_delay = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.timeout                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] neutron.version                = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] notifications.bdms_in_notifications = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] notifications.default_level    = INFO {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] notifications.notification_format = unversioned {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] notifications.notify_on_state_change = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] pci.alias                      = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] pci.device_spec                = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] pci.report_in_placement        = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.auth_section         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.auth_type            = password {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.cafile               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.certfile             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.collect_timing       = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.connect_retries      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.connect_retry_delay  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.default_domain_id    = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.default_domain_name  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.domain_id            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.domain_name          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.endpoint_override    = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.insecure             = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.keyfile              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.max_version          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.min_version          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.password             = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.project_domain_id    = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.project_domain_name  = Default {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.project_id           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.project_name         = service {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.region_name          = RegionOne {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.service_name         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.service_type         = placement {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.split_loggers        = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.status_code_retries  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.status_code_retry_delay = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.system_scope         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.timeout              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.trust_id             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.user_domain_id       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.user_domain_name     = Default {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.user_id              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.username             = placement {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] placement.version              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.cores                    = 20 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.count_usage_from_placement = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.injected_file_content_bytes = 10240 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.injected_file_path_length = 255 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.injected_files           = 5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.instances                = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.key_pairs                = 100 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.metadata_items           = 128 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.ram                      = 51200 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.recheck_quota            = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.server_group_members     = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] quota.server_groups            = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] rdp.enabled                    = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.image_metadata_prefilter = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.max_attempts         = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.max_placement_results = 1000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] scheduler.workers              = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.host_subset_size = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.isolated_hosts = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.isolated_images = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.pci_in_placement = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.track_instance_changes = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] metrics.required               = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] metrics.weight_multiplier      = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] metrics.weight_setting         = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] serial_console.enabled         = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] serial_console.port_range      = 10000:20000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] serial_console.serialproxy_port = 6083 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.auth_section      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.auth_type         = password {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.cafile            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.certfile          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.collect_timing    = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.insecure          = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.keyfile           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.send_service_user_token = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.split_loggers     = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] service_user.timeout           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.agent_enabled            = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.enabled                  = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.html5proxy_port          = 6082 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.image_compression        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.jpeg_compression         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.playback_compression     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.server_listen            = 127.0.0.1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.streaming_mode           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] spice.zlib_compression         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] upgrade_levels.baseapi         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] upgrade_levels.cert            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] upgrade_levels.compute         = auto {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] upgrade_levels.conductor       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] upgrade_levels.scheduler       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.cafile = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.certfile = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.insecure = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vendordata_dynamic_auth.timeout = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.api_retry_count         = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.ca_file                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.cache_prefix            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.cluster_name            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.connection_pool_size    = 10 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.console_delay_seconds   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.datastore_regex         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.host_ip                 = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.host_password           = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.host_port               = 443 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.host_username           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.insecure                = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.integration_bridge      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.maximum_objects         = 100 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.pbm_default_policy      = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.pbm_enabled             = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.pbm_wsdl_location       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.serial_port_proxy_uri   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.serial_port_service_uri = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.task_poll_interval      = 0.5 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.use_linked_clone        = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.vnc_keymap              = en-us {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.vnc_port                = 5900 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vmware.vnc_port_total          = 10000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.auth_schemes               = ['none'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.enabled                    = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.novncproxy_port            = 6080 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.vencrypt_ca_certs          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.vencrypt_client_cert       = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vnc.vencrypt_client_key        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.disable_rootwrap   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.enable_numa_live_migration = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.libvirt_disable_apic = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.client_socket_timeout     = 900 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.default_pool_size         = 1000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.keep_alive                = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.max_header_line           = 16384 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.ssl_ca_file               = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.ssl_cert_file             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.ssl_key_file              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.tcp_keepidle              = 600 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] zvm.ca_file                    = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] zvm.cloud_connector_url        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] zvm.reachable_timeout          = 300 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.enforce_new_defaults = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.enforce_scope      = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.policy_default_rule = default {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.connection_string     = messaging:// {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.enabled               = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.es_doc_type           = notification {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.es_scroll_size        = 10000 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.es_scroll_time        = 2m {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.filter_error_trace    = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.hmac_keys             = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.sentinel_service_name = mymaster {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.socket_timeout        = 0.1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.trace_requests        = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler.trace_sqlalchemy      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler_jaeger.process_tags   = {} {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler_jaeger.service_name_prefix = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] profiler_otlp.service_name_prefix = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] remote_debug.host              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] remote_debug.port              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_notifications.retry = -1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.auth_section        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.auth_type           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.cafile              = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.certfile            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.collect_timing      = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.connect_retries     = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.connect_retry_delay = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.endpoint_id         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.endpoint_override   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.insecure            = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.keyfile             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.max_version         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.min_version         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.region_name         = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.service_name        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.service_type        = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.split_loggers       = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.status_code_retries = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.status_code_retry_delay = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.timeout             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.valid_interfaces    = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_limit.version             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_reports.file_event_handler = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] oslo_reports.log_dir           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_ovs_privileged.group  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] vif_plug_ovs_privileged.user   = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_ovs.isolate_vif         = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] os_brick.lock_path             = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] privsep_osbrick.capabilities   = [21] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] privsep_osbrick.group          = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] privsep_osbrick.helper_command = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] privsep_osbrick.user           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] nova_sys_admin.group           = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] nova_sys_admin.helper_command  = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] nova_sys_admin.user            = None {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG oslo_service.service [None req-4f274ee6-de3a-414a-999a-a8cc7a65e5e2 None None] ******************************************************************************** {{(pid=73052) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 14:35:47 user nova-compute[73052]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 14:35:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Starting native event thread {{(pid=73052) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Starting green dispatch thread {{(pid=73052) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Starting connection event dispatch thread {{(pid=73052) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Connecting to libvirt: qemu:///system {{(pid=73052) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f08a98ea7a0> {{(pid=73052) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 14:35:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f08a98ea7a0> {{(pid=73052) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 14:35:47 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Connection event '1' reason 'None'
Aug 26 14:35:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 14:35:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.mount [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Initialising _HostMountState generation 0 {{(pid=73052) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 14:35:54 user nova-compute[73052]: INFO nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host capabilities <capabilities>
Aug 26 14:35:54 user nova-compute[73052]:   <host>
Aug 26 14:35:54 user nova-compute[73052]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 14:35:54 user nova-compute[73052]:     <cpu>
Aug 26 14:35:54 user nova-compute[73052]:       <arch>x86_64</arch>
Aug 26 14:35:54 user nova-compute[73052]:       <model>IvyBridge-IBRS</model>
Aug 26 14:35:54 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:54 user nova-compute[73052]:       <microcode version='1070'/>
Aug 26 14:35:54 user nova-compute[73052]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 14:35:54 user nova-compute[73052]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='ss'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='vmx'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='pcid'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='osxsave'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='hypervisor'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='arat'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='tsc_adjust'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='md-clear'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='stibp'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='arch-capabilities'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='ssbd'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='invtsc'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='rsba'/>
Aug 26 14:35:54 user nova-compute[73052]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 14:35:54 user nova-compute[73052]:       <pages unit='KiB' size='4'/>
Aug 26 14:35:54 user nova-compute[73052]:       <pages unit='KiB' size='2048'/>
Aug 26 14:35:54 user nova-compute[73052]:     </cpu>
Aug 26 14:35:54 user nova-compute[73052]:     <power_management>
Aug 26 14:35:54 user nova-compute[73052]:       <suspend_mem/>
Aug 26 14:35:54 user nova-compute[73052]:       <suspend_disk/>
Aug 26 14:35:54 user nova-compute[73052]:       <suspend_hybrid/>
Aug 26 14:35:54 user nova-compute[73052]:     </power_management>
Aug 26 14:35:54 user nova-compute[73052]:     <iommu support='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     <migration_features>
Aug 26 14:35:54 user nova-compute[73052]:       <live/>
Aug 26 14:35:54 user nova-compute[73052]:       <uri_transports>
Aug 26 14:35:54 user nova-compute[73052]:         <uri_transport>tcp</uri_transport>
Aug 26 14:35:54 user nova-compute[73052]:         <uri_transport>rdma</uri_transport>
Aug 26 14:35:54 user nova-compute[73052]:       </uri_transports>
Aug 26 14:35:54 user nova-compute[73052]:     </migration_features>
Aug 26 14:35:54 user nova-compute[73052]:     <topology>
Aug 26 14:35:54 user nova-compute[73052]:       <cells num='2'>
Aug 26 14:35:54 user nova-compute[73052]:         <cell id='0'>
Aug 26 14:35:54 user nova-compute[73052]:           <memory unit='KiB'>8189224</memory>
Aug 26 14:35:54 user nova-compute[73052]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 26 14:35:54 user nova-compute[73052]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 14:35:54 user nova-compute[73052]:           <distances>
Aug 26 14:35:54 user nova-compute[73052]:             <sibling id='0' value='10'/>
Aug 26 14:35:54 user nova-compute[73052]:             <sibling id='1' value='20'/>
Aug 26 14:35:54 user nova-compute[73052]:           </distances>
Aug 26 14:35:54 user nova-compute[73052]:           <cpus num='6'>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 14:35:54 user nova-compute[73052]:           </cpus>
Aug 26 14:35:54 user nova-compute[73052]:         </cell>
Aug 26 14:35:54 user nova-compute[73052]:         <cell id='1'>
Aug 26 14:35:54 user nova-compute[73052]:           <memory unit='KiB'>8206460</memory>
Aug 26 14:35:54 user nova-compute[73052]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 26 14:35:54 user nova-compute[73052]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 14:35:54 user nova-compute[73052]:           <distances>
Aug 26 14:35:54 user nova-compute[73052]:             <sibling id='0' value='20'/>
Aug 26 14:35:54 user nova-compute[73052]:             <sibling id='1' value='10'/>
Aug 26 14:35:54 user nova-compute[73052]:           </distances>
Aug 26 14:35:54 user nova-compute[73052]:           <cpus num='6'>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 14:35:54 user nova-compute[73052]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 14:35:54 user nova-compute[73052]:           </cpus>
Aug 26 14:35:54 user nova-compute[73052]:         </cell>
Aug 26 14:35:54 user nova-compute[73052]:       </cells>
Aug 26 14:35:54 user nova-compute[73052]:     </topology>
Aug 26 14:35:54 user nova-compute[73052]:     <cache>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 14:35:54 user nova-compute[73052]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 14:35:54 user nova-compute[73052]:     </cache>
Aug 26 14:35:54 user nova-compute[73052]:     <secmodel>
Aug 26 14:35:54 user nova-compute[73052]:       <model>apparmor</model>
Aug 26 14:35:54 user nova-compute[73052]:       <doi>0</doi>
Aug 26 14:35:54 user nova-compute[73052]:     </secmodel>
Aug 26 14:35:54 user nova-compute[73052]:     <secmodel>
Aug 26 14:35:54 user nova-compute[73052]:       <model>dac</model>
Aug 26 14:35:54 user nova-compute[73052]:       <doi>0</doi>
Aug 26 14:35:54 user nova-compute[73052]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 14:35:54 user nova-compute[73052]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 14:35:54 user nova-compute[73052]:     </secmodel>
Aug 26 14:35:54 user nova-compute[73052]:   </host>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='alpha'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>clipper</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='armv6l'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>spitz</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>nuri</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>kzm</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sx1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>z2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>tosa</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>n810</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>n800</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>terrier</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>midway</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>microbit</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>verdex</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>highbank</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>akita</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>connex</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>collie</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='armv7l'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>spitz</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>nuri</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>kzm</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sx1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>z2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>tosa</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>n810</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>n800</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>terrier</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>midway</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>microbit</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>verdex</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>highbank</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>akita</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>connex</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>collie</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='aarch64'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>spitz</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>nuri</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>kzm</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sx1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>z2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>tosa</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>n810</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>n800</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>terrier</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>midway</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>microbit</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>verdex</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='4'>highbank</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>akita</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>connex</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>collie</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <acpi default='on' toggle='yes'/>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='cris'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='i686'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>isapc</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>microvm</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='kvm'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <pae/>
Aug 26 14:35:54 user nova-compute[73052]:       <nonpae/>
Aug 26 14:35:54 user nova-compute[73052]:       <acpi default='on' toggle='yes'/>
Aug 26 14:35:54 user nova-compute[73052]:       <apic default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='m68k'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>an5206</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>q800</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='microblaze'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='microblazeel'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='mips'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='16'>malta</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='mipsel'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='16'>malta</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='mips64'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='16'>malta</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>pica61</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>magnum</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='mips64el'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='16'>malta</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>pica61</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>magnum</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='16'>boston</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='ppc'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>mac99</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>40p</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>taihu</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:54 user nova-compute[73052]:     </arch>
Aug 26 14:35:54 user nova-compute[73052]:     <features>
Aug 26 14:35:54 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:54 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:54 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:54 user nova-compute[73052]:     </features>
Aug 26 14:35:54 user nova-compute[73052]:   </guest>
Aug 26 14:35:54 user nova-compute[73052]:   <guest>
Aug 26 14:35:54 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:54 user nova-compute[73052]:     <arch name='ppc64'>
Aug 26 14:35:54 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:54 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>taihu</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>40p</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 14:35:54 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>mac99</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='ppc64le'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>taihu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>40p</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>mac99</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='riscv32'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='8'>spike</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='8'>virt</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='riscv64'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='8'>spike</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='8'>virt</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='s390x'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='sh4'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>shix</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>r2d</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='sh4eb'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>shix</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>r2d</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='sparc'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>LX</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='sparc64'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>niagara</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='x86_64'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>64</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='1'>isapc</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>microvm</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='kvm'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <acpi default='on' toggle='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:       <apic default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='xtensa'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='4'>sim</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>kc705</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>ml605</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>virt</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>lx200</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>lx60</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]:   <guest>
Aug 26 14:35:55 user nova-compute[73052]:     <os_type>hvm</os_type>
Aug 26 14:35:55 user nova-compute[73052]:     <arch name='xtensaeb'>
Aug 26 14:35:55 user nova-compute[73052]:       <wordsize>32</wordsize>
Aug 26 14:35:55 user nova-compute[73052]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='4'>sim</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>kc705</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>ml605</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>virt</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>lx200</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>lx60</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 14:35:55 user nova-compute[73052]:       <domain type='qemu'/>
Aug 26 14:35:55 user nova-compute[73052]:     </arch>
Aug 26 14:35:55 user nova-compute[73052]:     <features>
Aug 26 14:35:55 user nova-compute[73052]:       <cpuselection/>
Aug 26 14:35:55 user nova-compute[73052]:       <deviceboot/>
Aug 26 14:35:55 user nova-compute[73052]:       <disksnapshot default='on' toggle='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     </features>
Aug 26 14:35:55 user nova-compute[73052]:   </guest>
Aug 26 14:35:55 user nova-compute[73052]: </capabilities>
Aug 26 14:35:55 user nova-compute[73052]: 
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 14:35:55 user nova-compute[73052]: <domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 14:35:55 user nova-compute[73052]:   <domain>kvm</domain>
Aug 26 14:35:55 user nova-compute[73052]:   <machine>pc-i440fx-6.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:   <arch>i686</arch>
Aug 26 14:35:55 user nova-compute[73052]:   <vcpu max='255'/>
Aug 26 14:35:55 user nova-compute[73052]:   <iothreads supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:   <os supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='firmware'/>
Aug 26 14:35:55 user nova-compute[73052]:     <loader supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>rom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pflash</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='readonly'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='secure'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </loader>
Aug 26 14:35:55 user nova-compute[73052]:   </os>
Aug 26 14:35:55 user nova-compute[73052]:   <cpu>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-passthrough' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='hostPassthroughMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='maximum' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='maximumMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-model' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ss'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='vmx'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pcid'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='hypervisor'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arat'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='umip'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='md-clear'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibpb'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibrs'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='erms'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='lm'/>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='custom' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>qemu64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>qemu32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>phenom</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>n270</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>kvm64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>coreduo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>core2duo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>athlon</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Westmere</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Snowridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Penryn</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G5</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G4</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G1</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Rome</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Milan</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Dhyana</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cooperlake</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Conroe</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>486</model>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:   </cpu>
Aug 26 14:35:55 user nova-compute[73052]:   <memoryBacking supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='sourceType'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>file</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>anonymous</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>memfd</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:   </memoryBacking>
Aug 26 14:35:55 user nova-compute[73052]:   <devices>
Aug 26 14:35:55 user nova-compute[73052]:     <disk supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='diskDevice'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>disk</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cdrom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>floppy</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>lun</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='bus'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ide</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>fdc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sata</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </disk>
Aug 26 14:35:55 user nova-compute[73052]:     <graphics supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sdl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vnc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>spice</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egl-headless</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </graphics>
Aug 26 14:35:55 user nova-compute[73052]:     <video supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='modelType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cirrus</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vmvga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>qxl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>none</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>bochs</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ramfb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </video>
Aug 26 14:35:55 user nova-compute[73052]:     <hostdev supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='mode'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>subsystem</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='startupPolicy'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>default</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>mandatory</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>requisite</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>optional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='subsysType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pci</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='capsType'/>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='pciBackend'/>
Aug 26 14:35:55 user nova-compute[73052]:     </hostdev>
Aug 26 14:35:55 user nova-compute[73052]:     <rng supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>random</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egd</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>builtin</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </rng>
Aug 26 14:35:55 user nova-compute[73052]:     <filesystem supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='driverType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>path</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>handle</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtiofs</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </filesystem>
Aug 26 14:35:55 user nova-compute[73052]:     <tpm supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-tis</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-crb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>passthrough</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>emulator</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </tpm>
Aug 26 14:35:55 user nova-compute[73052]:   </devices>
Aug 26 14:35:55 user nova-compute[73052]:   <features>
Aug 26 14:35:55 user nova-compute[73052]:     <gic supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     <vmcoreinfo supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <genid supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backingStoreInput supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backup supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <sev supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:   </features>
Aug 26 14:35:55 user nova-compute[73052]: </domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 14:35:55 user nova-compute[73052]: <domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 14:35:55 user nova-compute[73052]:   <domain>kvm</domain>
Aug 26 14:35:55 user nova-compute[73052]:   <machine>pc-q35-6.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:   <arch>i686</arch>
Aug 26 14:35:55 user nova-compute[73052]:   <vcpu max='288'/>
Aug 26 14:35:55 user nova-compute[73052]:   <iothreads supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:   <os supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='firmware'/>
Aug 26 14:35:55 user nova-compute[73052]:     <loader supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>rom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pflash</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='readonly'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='secure'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </loader>
Aug 26 14:35:55 user nova-compute[73052]:   </os>
Aug 26 14:35:55 user nova-compute[73052]:   <cpu>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-passthrough' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='hostPassthroughMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='maximum' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='maximumMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-model' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ss'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='vmx'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pcid'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='hypervisor'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arat'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='umip'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='md-clear'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibpb'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibrs'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='erms'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='lm'/>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='custom' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>qemu64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>qemu32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>phenom</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>n270</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>kvm64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>coreduo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>core2duo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>athlon</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Westmere</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Snowridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Penryn</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G5</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G4</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G1</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Rome</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Milan</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Dhyana</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cooperlake</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Conroe</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>486</model>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:   </cpu>
Aug 26 14:35:55 user nova-compute[73052]:   <memoryBacking supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='sourceType'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>file</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>anonymous</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>memfd</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:   </memoryBacking>
Aug 26 14:35:55 user nova-compute[73052]:   <devices>
Aug 26 14:35:55 user nova-compute[73052]:     <disk supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='diskDevice'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>disk</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cdrom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>floppy</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>lun</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='bus'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>fdc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sata</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </disk>
Aug 26 14:35:55 user nova-compute[73052]:     <graphics supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sdl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vnc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>spice</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egl-headless</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </graphics>
Aug 26 14:35:55 user nova-compute[73052]:     <video supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='modelType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cirrus</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vmvga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>qxl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>none</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>bochs</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ramfb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </video>
Aug 26 14:35:55 user nova-compute[73052]:     <hostdev supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='mode'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>subsystem</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='startupPolicy'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>default</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>mandatory</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>requisite</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>optional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='subsysType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pci</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='capsType'/>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='pciBackend'/>
Aug 26 14:35:55 user nova-compute[73052]:     </hostdev>
Aug 26 14:35:55 user nova-compute[73052]:     <rng supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>random</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egd</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>builtin</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </rng>
Aug 26 14:35:55 user nova-compute[73052]:     <filesystem supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='driverType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>path</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>handle</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtiofs</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </filesystem>
Aug 26 14:35:55 user nova-compute[73052]:     <tpm supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-tis</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-crb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>passthrough</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>emulator</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </tpm>
Aug 26 14:35:55 user nova-compute[73052]:   </devices>
Aug 26 14:35:55 user nova-compute[73052]:   <features>
Aug 26 14:35:55 user nova-compute[73052]:     <gic supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     <vmcoreinfo supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <genid supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backingStoreInput supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backup supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <sev supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:   </features>
Aug 26 14:35:55 user nova-compute[73052]: </domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 14:35:55 user nova-compute[73052]: <domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 14:35:55 user nova-compute[73052]:   <domain>kvm</domain>
Aug 26 14:35:55 user nova-compute[73052]:   <machine>pc-q35-jammy</machine>
Aug 26 14:35:55 user nova-compute[73052]:   <arch>i686</arch>
Aug 26 14:35:55 user nova-compute[73052]:   <vcpu max='288'/>
Aug 26 14:35:55 user nova-compute[73052]:   <iothreads supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:   <os supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='firmware'/>
Aug 26 14:35:55 user nova-compute[73052]:     <loader supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>rom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pflash</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='readonly'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='secure'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </loader>
Aug 26 14:35:55 user nova-compute[73052]:   </os>
Aug 26 14:35:55 user nova-compute[73052]:   <cpu>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-passthrough' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='hostPassthroughMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='maximum' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='maximumMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-model' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ss'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='vmx'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pcid'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='hypervisor'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arat'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='umip'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='md-clear'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibpb'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibrs'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='erms'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='lm'/>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='custom' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>qemu64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>qemu32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>phenom</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>n270</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>kvm64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>coreduo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>core2duo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>athlon</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Westmere</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Snowridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Penryn</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G5</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G4</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G1</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Rome</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Milan</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Dhyana</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cooperlake</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Conroe</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>486</model>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:   </cpu>
Aug 26 14:35:55 user nova-compute[73052]:   <memoryBacking supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='sourceType'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>file</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>anonymous</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>memfd</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:   </memoryBacking>
Aug 26 14:35:55 user nova-compute[73052]:   <devices>
Aug 26 14:35:55 user nova-compute[73052]:     <disk supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='diskDevice'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>disk</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cdrom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>floppy</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>lun</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='bus'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>fdc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sata</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </disk>
Aug 26 14:35:55 user nova-compute[73052]:     <graphics supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sdl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vnc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>spice</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egl-headless</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </graphics>
Aug 26 14:35:55 user nova-compute[73052]:     <video supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='modelType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cirrus</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vmvga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>qxl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>none</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>bochs</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ramfb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </video>
Aug 26 14:35:55 user nova-compute[73052]:     <hostdev supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='mode'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>subsystem</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='startupPolicy'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>default</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>mandatory</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>requisite</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>optional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='subsysType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pci</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='capsType'/>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='pciBackend'/>
Aug 26 14:35:55 user nova-compute[73052]:     </hostdev>
Aug 26 14:35:55 user nova-compute[73052]:     <rng supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>random</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egd</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>builtin</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </rng>
Aug 26 14:35:55 user nova-compute[73052]:     <filesystem supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='driverType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>path</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>handle</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtiofs</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </filesystem>
Aug 26 14:35:55 user nova-compute[73052]:     <tpm supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-tis</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-crb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>passthrough</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>emulator</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </tpm>
Aug 26 14:35:55 user nova-compute[73052]:   </devices>
Aug 26 14:35:55 user nova-compute[73052]:   <features>
Aug 26 14:35:55 user nova-compute[73052]:     <gic supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     <vmcoreinfo supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <genid supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backingStoreInput supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backup supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <sev supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:   </features>
Aug 26 14:35:55 user nova-compute[73052]: </domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 14:35:55 user nova-compute[73052]: <domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 14:35:55 user nova-compute[73052]:   <domain>kvm</domain>
Aug 26 14:35:55 user nova-compute[73052]:   <machine>pc-i440fx-jammy</machine>
Aug 26 14:35:55 user nova-compute[73052]:   <arch>i686</arch>
Aug 26 14:35:55 user nova-compute[73052]:   <vcpu max='255'/>
Aug 26 14:35:55 user nova-compute[73052]:   <iothreads supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:   <os supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='firmware'/>
Aug 26 14:35:55 user nova-compute[73052]:     <loader supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>rom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pflash</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='readonly'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='secure'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </loader>
Aug 26 14:35:55 user nova-compute[73052]:   </os>
Aug 26 14:35:55 user nova-compute[73052]:   <cpu>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-passthrough' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='hostPassthroughMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='maximum' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='maximumMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-model' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ss'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='vmx'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pcid'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='hypervisor'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arat'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='umip'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='md-clear'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibpb'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibrs'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='erms'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='lm'/>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='custom' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>qemu64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>qemu32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>phenom</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>n270</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>kvm64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>coreduo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>core2duo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>athlon</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Westmere</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Snowridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Penryn</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G5</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G4</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G1</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Rome</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Milan</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Dhyana</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cooperlake</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Conroe</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>486</model>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:   </cpu>
Aug 26 14:35:55 user nova-compute[73052]:   <memoryBacking supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='sourceType'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>file</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>anonymous</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>memfd</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:   </memoryBacking>
Aug 26 14:35:55 user nova-compute[73052]:   <devices>
Aug 26 14:35:55 user nova-compute[73052]:     <disk supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='diskDevice'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>disk</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cdrom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>floppy</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>lun</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='bus'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ide</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>fdc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sata</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </disk>
Aug 26 14:35:55 user nova-compute[73052]:     <graphics supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sdl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vnc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>spice</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egl-headless</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </graphics>
Aug 26 14:35:55 user nova-compute[73052]:     <video supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='modelType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cirrus</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vmvga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>qxl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>none</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>bochs</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ramfb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </video>
Aug 26 14:35:55 user nova-compute[73052]:     <hostdev supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='mode'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>subsystem</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='startupPolicy'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>default</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>mandatory</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>requisite</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>optional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='subsysType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pci</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='capsType'/>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='pciBackend'/>
Aug 26 14:35:55 user nova-compute[73052]:     </hostdev>
Aug 26 14:35:55 user nova-compute[73052]:     <rng supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>random</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egd</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>builtin</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </rng>
Aug 26 14:35:55 user nova-compute[73052]:     <filesystem supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='driverType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>path</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>handle</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtiofs</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </filesystem>
Aug 26 14:35:55 user nova-compute[73052]:     <tpm supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-tis</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-crb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>passthrough</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>emulator</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </tpm>
Aug 26 14:35:55 user nova-compute[73052]:   </devices>
Aug 26 14:35:55 user nova-compute[73052]:   <features>
Aug 26 14:35:55 user nova-compute[73052]:     <gic supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     <vmcoreinfo supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <genid supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backingStoreInput supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backup supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <sev supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:   </features>
Aug 26 14:35:55 user nova-compute[73052]: </domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 14:35:55 user nova-compute[73052]: <domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 14:35:55 user nova-compute[73052]:   <domain>kvm</domain>
Aug 26 14:35:55 user nova-compute[73052]:   <machine>pc-i440fx-6.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:   <arch>x86_64</arch>
Aug 26 14:35:55 user nova-compute[73052]:   <vcpu max='255'/>
Aug 26 14:35:55 user nova-compute[73052]:   <iothreads supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:   <os supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='firmware'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>efi</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:     <loader supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>rom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pflash</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='readonly'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='secure'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </loader>
Aug 26 14:35:55 user nova-compute[73052]:   </os>
Aug 26 14:35:55 user nova-compute[73052]:   <cpu>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-passthrough' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='hostPassthroughMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='maximum' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='maximumMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-model' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ss'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='vmx'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pcid'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='hypervisor'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arat'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='umip'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='md-clear'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='invtsc'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibpb'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibrs'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='rsba'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='erms'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='custom' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>qemu64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>qemu32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>phenom</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>n270</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>coreduo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>core2duo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>athlon</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Westmere</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Snowridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Penryn</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G5</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G4</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Opteron_G1</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Rome</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Milan</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Dhyana</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cooperlake</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Conroe</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>486</model>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:   </cpu>
Aug 26 14:35:55 user nova-compute[73052]:   <memoryBacking supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='sourceType'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>file</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>anonymous</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>memfd</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:   </memoryBacking>
Aug 26 14:35:55 user nova-compute[73052]:   <devices>
Aug 26 14:35:55 user nova-compute[73052]:     <disk supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='diskDevice'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>disk</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cdrom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>floppy</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>lun</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='bus'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ide</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>fdc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sata</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </disk>
Aug 26 14:35:55 user nova-compute[73052]:     <graphics supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sdl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vnc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>spice</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egl-headless</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </graphics>
Aug 26 14:35:55 user nova-compute[73052]:     <video supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='modelType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cirrus</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vmvga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>qxl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>none</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>bochs</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ramfb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </video>
Aug 26 14:35:55 user nova-compute[73052]:     <hostdev supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='mode'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>subsystem</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='startupPolicy'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>default</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>mandatory</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>requisite</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>optional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='subsysType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pci</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='capsType'/>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='pciBackend'/>
Aug 26 14:35:55 user nova-compute[73052]:     </hostdev>
Aug 26 14:35:55 user nova-compute[73052]:     <rng supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>random</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egd</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>builtin</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </rng>
Aug 26 14:35:55 user nova-compute[73052]:     <filesystem supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='driverType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>path</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>handle</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtiofs</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </filesystem>
Aug 26 14:35:55 user nova-compute[73052]:     <tpm supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-tis</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-crb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>passthrough</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>emulator</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </tpm>
Aug 26 14:35:55 user nova-compute[73052]:   </devices>
Aug 26 14:35:55 user nova-compute[73052]:   <features>
Aug 26 14:35:55 user nova-compute[73052]:     <gic supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     <vmcoreinfo supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <genid supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backingStoreInput supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backup supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <sev supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:   </features>
Aug 26 14:35:55 user nova-compute[73052]: </domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 14:35:55 user nova-compute[73052]: <domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 14:35:55 user nova-compute[73052]:   <domain>kvm</domain>
Aug 26 14:35:55 user nova-compute[73052]:   <machine>pc-q35-6.2</machine>
Aug 26 14:35:55 user nova-compute[73052]:   <arch>x86_64</arch>
Aug 26 14:35:55 user nova-compute[73052]:   <vcpu max='288'/>
Aug 26 14:35:55 user nova-compute[73052]:   <iothreads supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:   <os supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='firmware'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>efi</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:     <loader supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>rom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pflash</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='readonly'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='secure'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </loader>
Aug 26 14:35:55 user nova-compute[73052]:   </os>
Aug 26 14:35:55 user nova-compute[73052]:   <cpu>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-passthrough' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='hostPassthroughMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='maximum' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='maximumMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-model' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ss'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='vmx'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pcid'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='hypervisor'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arat'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='umip'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='md-clear'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='invtsc'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibpb'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibrs'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='rsba'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='erms'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='custom' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>qemu64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>qemu32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>phenom</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>n270</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>coreduo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>core2duo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>athlon</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Westmere</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Snowridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Penryn</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G5</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G4</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Opteron_G1</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Rome</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Milan</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Dhyana</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cooperlake</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Conroe</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>486</model>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:   </cpu>
Aug 26 14:35:55 user nova-compute[73052]:   <memoryBacking supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='sourceType'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>file</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>anonymous</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>memfd</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:   </memoryBacking>
Aug 26 14:35:55 user nova-compute[73052]:   <devices>
Aug 26 14:35:55 user nova-compute[73052]:     <disk supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='diskDevice'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>disk</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cdrom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>floppy</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>lun</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='bus'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>fdc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sata</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </disk>
Aug 26 14:35:55 user nova-compute[73052]:     <graphics supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sdl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vnc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>spice</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egl-headless</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </graphics>
Aug 26 14:35:55 user nova-compute[73052]:     <video supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='modelType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cirrus</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vmvga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>qxl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>none</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>bochs</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ramfb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </video>
Aug 26 14:35:55 user nova-compute[73052]:     <hostdev supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='mode'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>subsystem</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='startupPolicy'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>default</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>mandatory</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>requisite</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>optional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='subsysType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pci</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='capsType'/>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='pciBackend'/>
Aug 26 14:35:55 user nova-compute[73052]:     </hostdev>
Aug 26 14:35:55 user nova-compute[73052]:     <rng supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>random</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egd</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>builtin</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </rng>
Aug 26 14:35:55 user nova-compute[73052]:     <filesystem supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='driverType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>path</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>handle</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtiofs</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </filesystem>
Aug 26 14:35:55 user nova-compute[73052]:     <tpm supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-tis</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-crb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>passthrough</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>emulator</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </tpm>
Aug 26 14:35:55 user nova-compute[73052]:   </devices>
Aug 26 14:35:55 user nova-compute[73052]:   <features>
Aug 26 14:35:55 user nova-compute[73052]:     <gic supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     <vmcoreinfo supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <genid supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backingStoreInput supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backup supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <sev supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:   </features>
Aug 26 14:35:55 user nova-compute[73052]: </domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 14:35:55 user nova-compute[73052]: <domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 14:35:55 user nova-compute[73052]:   <domain>kvm</domain>
Aug 26 14:35:55 user nova-compute[73052]:   <machine>pc-q35-jammy</machine>
Aug 26 14:35:55 user nova-compute[73052]:   <arch>x86_64</arch>
Aug 26 14:35:55 user nova-compute[73052]:   <vcpu max='288'/>
Aug 26 14:35:55 user nova-compute[73052]:   <iothreads supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:   <os supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='firmware'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>efi</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:     <loader supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>rom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pflash</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='readonly'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='secure'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </loader>
Aug 26 14:35:55 user nova-compute[73052]:   </os>
Aug 26 14:35:55 user nova-compute[73052]:   <cpu>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-passthrough' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='hostPassthroughMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='maximum' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='maximumMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-model' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ss'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='vmx'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pcid'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='hypervisor'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arat'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='umip'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='md-clear'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='invtsc'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibpb'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibrs'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='rsba'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='erms'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='custom' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>qemu64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>qemu32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>phenom</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>n270</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>coreduo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>core2duo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>athlon</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Westmere</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Snowridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Penryn</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G5</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G4</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Opteron_G1</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Rome</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Milan</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Dhyana</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cooperlake</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Conroe</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>486</model>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:   </cpu>
Aug 26 14:35:55 user nova-compute[73052]:   <memoryBacking supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='sourceType'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>file</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>anonymous</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>memfd</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:   </memoryBacking>
Aug 26 14:35:55 user nova-compute[73052]:   <devices>
Aug 26 14:35:55 user nova-compute[73052]:     <disk supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='diskDevice'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>disk</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cdrom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>floppy</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>lun</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='bus'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>fdc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sata</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </disk>
Aug 26 14:35:55 user nova-compute[73052]:     <graphics supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sdl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vnc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>spice</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egl-headless</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </graphics>
Aug 26 14:35:55 user nova-compute[73052]:     <video supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='modelType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cirrus</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vmvga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>qxl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>none</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>bochs</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ramfb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </video>
Aug 26 14:35:55 user nova-compute[73052]:     <hostdev supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='mode'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>subsystem</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='startupPolicy'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>default</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>mandatory</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>requisite</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>optional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='subsysType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pci</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='capsType'/>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='pciBackend'/>
Aug 26 14:35:55 user nova-compute[73052]:     </hostdev>
Aug 26 14:35:55 user nova-compute[73052]:     <rng supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>random</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egd</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>builtin</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </rng>
Aug 26 14:35:55 user nova-compute[73052]:     <filesystem supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='driverType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>path</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>handle</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtiofs</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </filesystem>
Aug 26 14:35:55 user nova-compute[73052]:     <tpm supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-tis</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-crb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>passthrough</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>emulator</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </tpm>
Aug 26 14:35:55 user nova-compute[73052]:   </devices>
Aug 26 14:35:55 user nova-compute[73052]:   <features>
Aug 26 14:35:55 user nova-compute[73052]:     <gic supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     <vmcoreinfo supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <genid supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backingStoreInput supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backup supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <sev supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:   </features>
Aug 26 14:35:55 user nova-compute[73052]: </domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 14:35:55 user nova-compute[73052]: <domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 14:35:55 user nova-compute[73052]:   <domain>kvm</domain>
Aug 26 14:35:55 user nova-compute[73052]:   <machine>pc-i440fx-jammy</machine>
Aug 26 14:35:55 user nova-compute[73052]:   <arch>x86_64</arch>
Aug 26 14:35:55 user nova-compute[73052]:   <vcpu max='255'/>
Aug 26 14:35:55 user nova-compute[73052]:   <iothreads supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:   <os supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='firmware'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>efi</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:     <loader supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>rom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pflash</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='readonly'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>yes</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='secure'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>no</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </loader>
Aug 26 14:35:55 user nova-compute[73052]:   </os>
Aug 26 14:35:55 user nova-compute[73052]:   <cpu>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-passthrough' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='hostPassthroughMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='maximum' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='maximumMigratable'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>on</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>off</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='host-model' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <vendor>Intel</vendor>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ss'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='vmx'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pcid'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='hypervisor'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arat'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='umip'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='md-clear'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='invtsc'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibpb'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='ibrs'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-stibp'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='rsba'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='erms'/>
Aug 26 14:35:55 user nova-compute[73052]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:     <mode name='custom' supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>qemu64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>qemu32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>phenom</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>pentium</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>n270</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm64</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>kvm32</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>coreduo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>core2duo</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>athlon</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Westmere</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Snowridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Skylake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>SandyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Penryn</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G5</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G4</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G3</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Opteron_G2</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Opteron_G1</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>IvyBridge</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Icelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Haswell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Rome</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-Milan</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>EPYC</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Dhyana</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cooperlake</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>Conroe</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='no'>Broadwell</model>
Aug 26 14:35:55 user nova-compute[73052]:       <model usable='yes'>486</model>
Aug 26 14:35:55 user nova-compute[73052]:     </mode>
Aug 26 14:35:55 user nova-compute[73052]:   </cpu>
Aug 26 14:35:55 user nova-compute[73052]:   <memoryBacking supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:     <enum name='sourceType'>
Aug 26 14:35:55 user nova-compute[73052]:       <value>file</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>anonymous</value>
Aug 26 14:35:55 user nova-compute[73052]:       <value>memfd</value>
Aug 26 14:35:55 user nova-compute[73052]:     </enum>
Aug 26 14:35:55 user nova-compute[73052]:   </memoryBacking>
Aug 26 14:35:55 user nova-compute[73052]:   <devices>
Aug 26 14:35:55 user nova-compute[73052]:     <disk supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='diskDevice'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>disk</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cdrom</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>floppy</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>lun</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='bus'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ide</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>fdc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sata</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </disk>
Aug 26 14:35:55 user nova-compute[73052]:     <graphics supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='type'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>sdl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vnc</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>spice</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egl-headless</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </graphics>
Aug 26 14:35:55 user nova-compute[73052]:     <video supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='modelType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>cirrus</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>vmvga</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>qxl</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>none</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>bochs</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>ramfb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </video>
Aug 26 14:35:55 user nova-compute[73052]:     <hostdev supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='mode'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>subsystem</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='startupPolicy'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>default</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>mandatory</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>requisite</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>optional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='subsysType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>usb</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>pci</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>scsi</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='capsType'/>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='pciBackend'/>
Aug 26 14:35:55 user nova-compute[73052]:     </hostdev>
Aug 26 14:35:55 user nova-compute[73052]:     <rng supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtio-non-transitional</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>random</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>egd</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>builtin</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </rng>
Aug 26 14:35:55 user nova-compute[73052]:     <filesystem supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='driverType'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>path</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>handle</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>virtiofs</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </filesystem>
Aug 26 14:35:55 user nova-compute[73052]:     <tpm supported='yes'>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='model'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-tis</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>tpm-crb</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:       <enum name='backendModel'>
Aug 26 14:35:55 user nova-compute[73052]:         <value>passthrough</value>
Aug 26 14:35:55 user nova-compute[73052]:         <value>emulator</value>
Aug 26 14:35:55 user nova-compute[73052]:       </enum>
Aug 26 14:35:55 user nova-compute[73052]:     </tpm>
Aug 26 14:35:55 user nova-compute[73052]:   </devices>
Aug 26 14:35:55 user nova-compute[73052]:   <features>
Aug 26 14:35:55 user nova-compute[73052]:     <gic supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:     <vmcoreinfo supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <genid supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backingStoreInput supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <backup supported='yes'/>
Aug 26 14:35:55 user nova-compute[73052]:     <sev supported='no'/>
Aug 26 14:35:55 user nova-compute[73052]:   </features>
Aug 26 14:35:55 user nova-compute[73052]: </domainCapabilities>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73052) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73052) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Checking secure boot support for host arch (x86_64) {{(pid=73052) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Checking secure boot support for host arch (x86_64) {{(pid=73052) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Checking secure boot support for host arch (x86_64) {{(pid=73052) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 14:35:55 user nova-compute[73052]: INFO nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Secure Boot support detected
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] cpu compare xml: <cpu match="exact">
Aug 26 14:35:55 user nova-compute[73052]:   <model>Nehalem</model>
Aug 26 14:35:55 user nova-compute[73052]: </cpu>
Aug 26 14:35:55 user nova-compute[73052]:  {{(pid=73052) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 14:35:55 user nova-compute[73052]: INFO nova.virt.node [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Generated node identity 63e4ae70-0fae-4216-9a6e-92eef5558363
Aug 26 14:35:55 user nova-compute[73052]: INFO nova.virt.node [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Wrote node identity 63e4ae70-0fae-4216-9a6e-92eef5558363 to /opt/stack/data/nova/compute_id
Aug 26 14:35:55 user nova-compute[73052]: WARNING nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Compute nodes ['63e4ae70-0fae-4216-9a6e-92eef5558363'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 14:35:55 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 14:35:55 user nova-compute[73052]: WARNING nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 14:35:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:35:55 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:35:55 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Hypervisor/Node resource view: name=user free_ram=10906MB free_disk=26.22176742553711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:35:55 user nova-compute[73052]: WARNING nova.compute.resource_tracker [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] No compute node record for user:63e4ae70-0fae-4216-9a6e-92eef5558363: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 63e4ae70-0fae-4216-9a6e-92eef5558363 could not be found.
Aug 26 14:35:55 user nova-compute[73052]: INFO nova.compute.resource_tracker [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Compute node record created for user:user with uuid: 63e4ae70-0fae-4216-9a6e-92eef5558363
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:35:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:35:55 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [req-b4a4a3f4-3834-41de-a9c7-df8821b4d3d3] Created resource provider record via placement API for resource provider with UUID 63e4ae70-0fae-4216-9a6e-92eef5558363 and name user.
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73052) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 14:35:56 user nova-compute[73052]: INFO nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] kernel doesn't support AMD SEV
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Libvirt baseline CPU <cpu>
Aug 26 14:35:56 user nova-compute[73052]:   <arch>x86_64</arch>
Aug 26 14:35:56 user nova-compute[73052]:   <model>Nehalem</model>
Aug 26 14:35:56 user nova-compute[73052]:   <vendor>Intel</vendor>
Aug 26 14:35:56 user nova-compute[73052]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 14:35:56 user nova-compute[73052]: </cpu>
Aug 26 14:35:56 user nova-compute[73052]:  {{(pid=73052) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Updated inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Updating resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 generation from 0 to 1 during operation: update_inventory {{(pid=73052) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Updating resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 generation from 1 to 2 during operation: update_traits {{(pid=73052) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.service [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Creating RPC server for service compute {{(pid=73052) start /opt/stack/nova/nova/service.py:182}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.service [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Join ServiceGroup membership for this service compute {{(pid=73052) start /opt/stack/nova/nova/service.py:199}}
Aug 26 14:35:56 user nova-compute[73052]: DEBUG nova.servicegroup.drivers.db [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73052) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 14:36:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:36:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:36:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:36:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:36:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=10316MB free_disk=26.125476837158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:36:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:36:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:36:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:36:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:36:47 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:36:47 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:36:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:36:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:37:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:37:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:37:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:37:48 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:37:49 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:37:49 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:37:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=10223MB free_disk=26.172168731689453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:37:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:37:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:37:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:37:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:37:49 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:37:49 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:37:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:37:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:38:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:38:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:38:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:38:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:38:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:38:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:38:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:38:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 14:38:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:38:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:38:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:38:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:38:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:38:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:38:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:38:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:38:50 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:38:50 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:38:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=10266MB free_disk=25.955799102783203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:38:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:38:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:38:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:38:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:38:50 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:38:50 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:38:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:38:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:38:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:39:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:39:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 14:39:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:39:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:39:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:39:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:39:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:39:51 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:39:52 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:39:52 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:39:52 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=9482MB free_disk=25.978519439697266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:39:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:39:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:39:52 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:39:52 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:39:52 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:39:52 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:39:52 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:39:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:39:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "79922a3f-53e3-4d29-8000-902e986e30c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:39:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "79922a3f-53e3-4d29-8000-902e986e30c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:39:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:39:57 user nova-compute[73052]: INFO nova.compute.claims [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Claim successful on node user
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:39:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:39:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Creating image(s)
Aug 26 14:39:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "/opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "/opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "/opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:39:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG nova.policy [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '321c53c447cb491585e8eb540b0f4157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbaaf64cd44c06b2c1ef28d17c28cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a.part --force-share --output=json" returned: 0 in 0.166s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG nova.virt.images [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] a9d03ca9-51ef-4843-bf03-544c5298003b was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a.part /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a.part /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a.converted" returned: 0 in 0.228s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:39:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.076s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:39:58 user nova-compute[73052]: INFO oslo.privsep.daemon [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8pgg6oxi/privsep.sock']
Aug 26 14:39:58 user sudo[82324]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8pgg6oxi/privsep.sock
Aug 26 14:39:58 user sudo[82324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 14:39:59 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Successfully created port: 903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:00 user sudo[82324]: pam_unix(sudo:session): session closed for user root
Aug 26 14:40:00 user nova-compute[73052]: INFO oslo.privsep.daemon [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Spawned new privsep daemon via rootwrap
Aug 26 14:40:00 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 14:40:00 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 14:40:00 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 14:40:00 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82353
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.169s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk 1073741824" returned: 0 in 0.055s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Cannot resize image /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Ensure instance console log exists: /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:02 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Successfully updated port: 903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquired lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:02 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:40:03 user nova-compute[73052]: INFO nova.compute.claims [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Claim successful on node user
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-0f9ee8d7-8bf3-4da8-8c98-128e6c0434d4 req-534459be-8c06-4016-a834-58fcc8859e49 service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received event network-changed-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-0f9ee8d7-8bf3-4da8-8c98-128e6c0434d4 req-534459be-8c06-4016-a834-58fcc8859e49 service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Refreshing instance network info cache due to event network-changed-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0f9ee8d7-8bf3-4da8-8c98-128e6c0434d4 req-534459be-8c06-4016-a834-58fcc8859e49 service nova] Acquiring lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:40:03 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:40:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:40:04 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Creating image(s)
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.219s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Updating instance_info_cache with network_info: [{"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Releasing lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Instance network_info: |[{"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.policy [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '966347969be04bb9a69cbdc441a94d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6426cc5de72e40e4ba4570304328a568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0f9ee8d7-8bf3-4da8-8c98-128e6c0434d4 req-534459be-8c06-4016-a834-58fcc8859e49 service nova] Acquired lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.network.neutron [req-0f9ee8d7-8bf3-4da8-8c98-128e6c0434d4 req-534459be-8c06-4016-a834-58fcc8859e49 service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Refreshing network info cache for port 903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Start _get_guest_xml network_info=[{"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:04 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:04 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-811964041',display_name='tempest-ServersNegativeTestJSON-server-811964041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-811964041',id=1,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bbaaf64cd44c06b2c1ef28d17c28cb',ramdisk_id='',reservation_id='r-4nbwvh1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-618175231',owner_user_name='tempest-ServersNegativeTestJSON-618175231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:39:58Z,user_data=None,user_id='321c53c447cb491585e8eb540b0f4157',uuid=79922a3f-53e3-4d29-8000-902e986e30c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converting VIF {"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:51:61,bridge_name='br-int',has_traffic_filtering=True,id=903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903800ed-8b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lazy-loading 'pci_devices' on Instance uuid 79922a3f-53e3-4d29-8000-902e986e30c0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:04 user nova-compute[73052]:   <uuid>79922a3f-53e3-4d29-8000-902e986e30c0</uuid>
Aug 26 14:40:04 user nova-compute[73052]:   <name>instance-00000001</name>
Aug 26 14:40:04 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:04 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:04 user nova-compute[73052]:   <metadata>
Aug 26 14:40:04 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:04 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:04 user nova-compute[73052]:       <nova:name>tempest-ServersNegativeTestJSON-server-811964041</nova:name>
Aug 26 14:40:04 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:04</nova:creationTime>
Aug 26 14:40:04 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:04 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:04 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:04 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:04 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:04 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:04 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:04 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:04 user nova-compute[73052]:         <nova:user uuid="321c53c447cb491585e8eb540b0f4157">tempest-ServersNegativeTestJSON-618175231-project-member</nova:user>
Aug 26 14:40:04 user nova-compute[73052]:         <nova:project uuid="d5bbaaf64cd44c06b2c1ef28d17c28cb">tempest-ServersNegativeTestJSON-618175231</nova:project>
Aug 26 14:40:04 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:04 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:40:04 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:04 user nova-compute[73052]:         <nova:port uuid="903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f">
Aug 26 14:40:04 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 14:40:04 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:04 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:04 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:04 user nova-compute[73052]:   </metadata>
Aug 26 14:40:04 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:04 user nova-compute[73052]:     <system>
Aug 26 14:40:04 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:04 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:04 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:04 user nova-compute[73052]:       <entry name="serial">79922a3f-53e3-4d29-8000-902e986e30c0</entry>
Aug 26 14:40:04 user nova-compute[73052]:       <entry name="uuid">79922a3f-53e3-4d29-8000-902e986e30c0</entry>
Aug 26 14:40:04 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:04 user nova-compute[73052]:     </system>
Aug 26 14:40:04 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:04 user nova-compute[73052]:   <os>
Aug 26 14:40:04 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:04 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:04 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:04 user nova-compute[73052]:   </os>
Aug 26 14:40:04 user nova-compute[73052]:   <features>
Aug 26 14:40:04 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:04 user nova-compute[73052]:     <apic/>
Aug 26 14:40:04 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:04 user nova-compute[73052]:   </features>
Aug 26 14:40:04 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:04 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:04 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:04 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:04 user nova-compute[73052]:   </clock>
Aug 26 14:40:04 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:04 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:04 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:04 user nova-compute[73052]:   </cpu>
Aug 26 14:40:04 user nova-compute[73052]:   <devices>
Aug 26 14:40:04 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:04 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:04 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk"/>
Aug 26 14:40:04 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:40:04 user nova-compute[73052]:     </disk>
Aug 26 14:40:04 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:04 user nova-compute[73052]:       <mac address="fa:16:3e:af:51:61"/>
Aug 26 14:40:04 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:04 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:04 user nova-compute[73052]:       <target dev="tap903800ed-8b"/>
Aug 26 14:40:04 user nova-compute[73052]:     </interface>
Aug 26 14:40:04 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:04 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/console.log" append="off"/>
Aug 26 14:40:04 user nova-compute[73052]:     </serial>
Aug 26 14:40:04 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:04 user nova-compute[73052]:     <video>
Aug 26 14:40:04 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:04 user nova-compute[73052]:     </video>
Aug 26 14:40:04 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:04 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:04 user nova-compute[73052]:     </rng>
Aug 26 14:40:04 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:04 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:04 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:04 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:04 user nova-compute[73052]:   </devices>
Aug 26 14:40:04 user nova-compute[73052]: </domain>
Aug 26 14:40:04 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-811964041',display_name='tempest-ServersNegativeTestJSON-server-811964041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-811964041',id=1,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bbaaf64cd44c06b2c1ef28d17c28cb',ramdisk_id='',reservation_id='r-4nbwvh1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-618175231',owner_user_name='tempest-ServersNegativeTestJSON-618175231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:39:58Z,user_data=None,user_id='321c53c447cb491585e8eb540b0f4157',uuid=79922a3f-53e3-4d29-8000-902e986e30c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converting VIF {"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:51:61,bridge_name='br-int',has_traffic_filtering=True,id=903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903800ed-8b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG os_vif [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:51:61,bridge_name='br-int',has_traffic_filtering=True,id=903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903800ed-8b') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Created schema index Interface.name {{(pid=73052) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Created schema index Port.name {{(pid=73052) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Created schema index Bridge.name {{(pid=73052) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk 1073741824" returned: 0 in 0.164s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.379s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [POLLOUT] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:04 user nova-compute[73052]: INFO oslo.privsep.daemon [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpanw72299/privsep.sock']
Aug 26 14:40:04 user sudo[82399]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpanw72299/privsep.sock
Aug 26 14:40:04 user sudo[82399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.236s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Cannot resize image /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Ensure instance console log exists: /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "eb6033f4-da59-4900-a67f-1e244631f046" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:40:06 user nova-compute[73052]: INFO nova.compute.claims [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Claim successful on node user
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.233s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:40:06 user nova-compute[73052]: INFO nova.compute.claims [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Claim successful on node user
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:40:06 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.policy [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '966347969be04bb9a69cbdc441a94d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6426cc5de72e40e4ba4570304328a568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Successfully created port: f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:40:06 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Creating image(s)
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.206s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:40:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:40:07 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:40:07 user sudo[82399]: pam_unix(sudo:session): session closed for user root
Aug 26 14:40:07 user nova-compute[73052]: INFO oslo.privsep.daemon [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Spawned new privsep daemon via rootwrap
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.network.neutron [req-0f9ee8d7-8bf3-4da8-8c98-128e6c0434d4 req-534459be-8c06-4016-a834-58fcc8859e49 service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Updated VIF entry in instance network info cache for port 903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.network.neutron [req-0f9ee8d7-8bf3-4da8-8c98-128e6c0434d4 req-534459be-8c06-4016-a834-58fcc8859e49 service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Updating instance_info_cache with network_info: [{"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:07 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 14:40:07 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 14:40:07 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 14:40:07 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82415
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0f9ee8d7-8bf3-4da8-8c98-128e6c0434d4 req-534459be-8c06-4016-a834-58fcc8859e49 service nova] Releasing lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.209s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk 1073741824" returned: 0 in 0.077s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:40:07 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Creating image(s)
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.198s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.policy [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2513642eea3411b9c8c33714bd2f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267e3757f3624d869a2e5e3d31376b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.235s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Cannot resize image /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Ensure instance console log exists: /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903800ed-8b, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap903800ed-8b, col_values=(('external_ids', {'iface-id': '903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:51:61', 'vm-uuid': '79922a3f-53e3-4d29-8000-902e986e30c0'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:07 user nova-compute[73052]: INFO os_vif [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:51:61,bridge_name='br-int',has_traffic_filtering=True,id=903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903800ed-8b')
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk 1073741824" returned: 0 in 0.048s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] No VIF found with MAC fa:16:3e:af:51:61, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.252s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Successfully updated port: f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquired lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-389b79df-c89a-4f47-9f1d-d1ba0639ac51 req-6e20a549-b344-461d-8610-8cbcd9f9de5b service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-changed-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-389b79df-c89a-4f47-9f1d-d1ba0639ac51 req-6e20a549-b344-461d-8610-8cbcd9f9de5b service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Refreshing instance network info cache due to event network-changed-f91967ed-1d90-4f7a-9265-4d13731fa7ef. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-389b79df-c89a-4f47-9f1d-d1ba0639ac51 req-6e20a549-b344-461d-8610-8cbcd9f9de5b service nova] Acquiring lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Cannot resize image /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Ensure instance console log exists: /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Releasing lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance network_info: |[{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-389b79df-c89a-4f47-9f1d-d1ba0639ac51 req-6e20a549-b344-461d-8610-8cbcd9f9de5b service nova] Acquired lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.network.neutron [req-389b79df-c89a-4f47-9f1d-d1ba0639ac51 req-6e20a549-b344-461d-8610-8cbcd9f9de5b service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Refreshing network info cache for port f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Start _get_guest_xml network_info=[{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-306863605',display_name='tempest-ServerRescueNegativeTestJSON-server-306863605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-306863605',id=2,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-x7v6rmb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:04Z,user_data=None,user_id='966347969be04bb9a69cbdc441a94d8f',uuid=36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a9:06,bridge_name='br-int',has_traffic_filtering=True,id=f91967ed-1d90-4f7a-9265-4d13731fa7ef,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91967ed-1d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'pci_devices' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:09 user nova-compute[73052]:   <uuid>36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749</uuid>
Aug 26 14:40:09 user nova-compute[73052]:   <name>instance-00000002</name>
Aug 26 14:40:09 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:09 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:09 user nova-compute[73052]:   <metadata>
Aug 26 14:40:09 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:09 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:09 user nova-compute[73052]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-306863605</nova:name>
Aug 26 14:40:09 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:09</nova:creationTime>
Aug 26 14:40:09 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:09 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:09 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:09 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:09 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:09 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:09 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:09 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:09 user nova-compute[73052]:         <nova:user uuid="966347969be04bb9a69cbdc441a94d8f">tempest-ServerRescueNegativeTestJSON-2104819576-project-member</nova:user>
Aug 26 14:40:09 user nova-compute[73052]:         <nova:project uuid="6426cc5de72e40e4ba4570304328a568">tempest-ServerRescueNegativeTestJSON-2104819576</nova:project>
Aug 26 14:40:09 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:09 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:40:09 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:09 user nova-compute[73052]:         <nova:port uuid="f91967ed-1d90-4f7a-9265-4d13731fa7ef">
Aug 26 14:40:09 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 14:40:09 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:09 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:09 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:09 user nova-compute[73052]:   </metadata>
Aug 26 14:40:09 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:09 user nova-compute[73052]:     <system>
Aug 26 14:40:09 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:09 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:09 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:09 user nova-compute[73052]:       <entry name="serial">36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749</entry>
Aug 26 14:40:09 user nova-compute[73052]:       <entry name="uuid">36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749</entry>
Aug 26 14:40:09 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:09 user nova-compute[73052]:     </system>
Aug 26 14:40:09 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:09 user nova-compute[73052]:   <os>
Aug 26 14:40:09 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:09 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:09 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:09 user nova-compute[73052]:   </os>
Aug 26 14:40:09 user nova-compute[73052]:   <features>
Aug 26 14:40:09 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:09 user nova-compute[73052]:     <apic/>
Aug 26 14:40:09 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:09 user nova-compute[73052]:   </features>
Aug 26 14:40:09 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:09 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:09 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:09 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:09 user nova-compute[73052]:   </clock>
Aug 26 14:40:09 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:09 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:09 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:09 user nova-compute[73052]:   </cpu>
Aug 26 14:40:09 user nova-compute[73052]:   <devices>
Aug 26 14:40:09 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:09 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:09 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk"/>
Aug 26 14:40:09 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:40:09 user nova-compute[73052]:     </disk>
Aug 26 14:40:09 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:09 user nova-compute[73052]:       <mac address="fa:16:3e:d9:a9:06"/>
Aug 26 14:40:09 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:09 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:09 user nova-compute[73052]:       <target dev="tapf91967ed-1d"/>
Aug 26 14:40:09 user nova-compute[73052]:     </interface>
Aug 26 14:40:09 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:09 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/console.log" append="off"/>
Aug 26 14:40:09 user nova-compute[73052]:     </serial>
Aug 26 14:40:09 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:09 user nova-compute[73052]:     <video>
Aug 26 14:40:09 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:09 user nova-compute[73052]:     </video>
Aug 26 14:40:09 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:09 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:09 user nova-compute[73052]:     </rng>
Aug 26 14:40:09 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:09 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:09 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:09 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:09 user nova-compute[73052]:   </devices>
Aug 26 14:40:09 user nova-compute[73052]: </domain>
Aug 26 14:40:09 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-306863605',display_name='tempest-ServerRescueNegativeTestJSON-server-306863605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-306863605',id=2,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-x7v6rmb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:04Z,user_data=None,user_id='966347969be04bb9a69cbdc441a94d8f',uuid=36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a9:06,bridge_name='br-int',has_traffic_filtering=True,id=f91967ed-1d90-4f7a-9265-4d13731fa7ef,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91967ed-1d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG os_vif [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a9:06,bridge_name='br-int',has_traffic_filtering=True,id=f91967ed-1d90-4f7a-9265-4d13731fa7ef,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91967ed-1d') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf91967ed-1d, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf91967ed-1d, col_values=(('external_ids', {'iface-id': 'f91967ed-1d90-4f7a-9265-4d13731fa7ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:a9:06', 'vm-uuid': '36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:09 user nova-compute[73052]: INFO os_vif [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a9:06,bridge_name='br-int',has_traffic_filtering=True,id=f91967ed-1d90-4f7a-9265-4d13731fa7ef,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91967ed-1d')
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Successfully created port: b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No VIF found with MAC fa:16:3e:d9:a9:06, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:10 user nova-compute[73052]: DEBUG nova.network.neutron [req-389b79df-c89a-4f47-9f1d-d1ba0639ac51 req-6e20a549-b344-461d-8610-8cbcd9f9de5b service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updated VIF entry in instance network info cache for port f91967ed-1d90-4f7a-9265-4d13731fa7ef. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:10 user nova-compute[73052]: DEBUG nova.network.neutron [req-389b79df-c89a-4f47-9f1d-d1ba0639ac51 req-6e20a549-b344-461d-8610-8cbcd9f9de5b service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-389b79df-c89a-4f47-9f1d-d1ba0639ac51 req-6e20a549-b344-461d-8610-8cbcd9f9de5b service nova] Releasing lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Successfully created port: f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060812.1978345, 79922a3f-53e3-4d29-8000-902e986e30c0 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:12 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] VM Resumed (Lifecycle Event)
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Instance spawned successfully.
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:12 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060812.1981113, 79922a3f-53e3-4d29-8000-902e986e30c0 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:12 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] VM Started (Lifecycle Event)
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.network.neutron [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Successfully updated port: b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquired lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.network.neutron [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:12 user nova-compute[73052]: INFO nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Took 14.62 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:12 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.network.neutron [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:12 user nova-compute[73052]: INFO nova.compute.manager [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Took 15.49 seconds to build instance.
Aug 26 14:40:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2ca64c75-69b3-40a1-9a6e-067a674ae9e4 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "79922a3f-53e3-4d29-8000-902e986e30c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.698s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.compute.manager [req-bdc579b1-be87-403d-8be4-72dabce80e11 req-ea55a8d4-89ba-4655-a18f-3183814a36ca service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received event network-changed-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG nova.compute.manager [req-bdc579b1-be87-403d-8be4-72dabce80e11 req-ea55a8d4-89ba-4655-a18f-3183814a36ca service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Refreshing instance network info cache due to event network-changed-b3728317-0c63-410c-bdb3-60166f01310d. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bdc579b1-be87-403d-8be4-72dabce80e11 req-ea55a8d4-89ba-4655-a18f-3183814a36ca service nova] Acquiring lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060813.0686452, 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:13 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] VM Resumed (Lifecycle Event)
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance spawned successfully.
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:13 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060813.068995, 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:13 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] VM Started (Lifecycle Event)
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:13 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:13 user nova-compute[73052]: INFO nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Took 9.11 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:13 user nova-compute[73052]: INFO nova.compute.manager [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Took 10.07 seconds to build instance.
Aug 26 14:40:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3e75fc1-2bce-4427-b480-8062f0666bd9 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.438s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Successfully updated port: f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquired lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updating instance_info_cache with network_info: [{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Releasing lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Instance network_info: |[{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bdc579b1-be87-403d-8be4-72dabce80e11 req-ea55a8d4-89ba-4655-a18f-3183814a36ca service nova] Acquired lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.network.neutron [req-bdc579b1-be87-403d-8be4-72dabce80e11 req-ea55a8d4-89ba-4655-a18f-3183814a36ca service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Refreshing network info cache for port b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Start _get_guest_xml network_info=[{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:14 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:14 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-245647396',display_name='tempest-ServerRescueNegativeTestJSON-server-245647396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-245647396',id=3,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-skvo5tlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:07Z,user_data=None,user_id='966347969be04bb9a69cbdc441a94d8f',uuid=eb6033f4-da59-4900-a67f-1e244631f046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=b3728317-0c63-410c-bdb3-60166f01310d,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3728317-0c') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.objects.instance [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'pci_devices' on Instance uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:14 user nova-compute[73052]:   <uuid>eb6033f4-da59-4900-a67f-1e244631f046</uuid>
Aug 26 14:40:14 user nova-compute[73052]:   <name>instance-00000003</name>
Aug 26 14:40:14 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:14 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:14 user nova-compute[73052]:   <metadata>
Aug 26 14:40:14 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:14 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:14 user nova-compute[73052]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-245647396</nova:name>
Aug 26 14:40:14 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:14</nova:creationTime>
Aug 26 14:40:14 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:14 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:14 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:14 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:14 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:14 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:14 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:14 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:14 user nova-compute[73052]:         <nova:user uuid="966347969be04bb9a69cbdc441a94d8f">tempest-ServerRescueNegativeTestJSON-2104819576-project-member</nova:user>
Aug 26 14:40:14 user nova-compute[73052]:         <nova:project uuid="6426cc5de72e40e4ba4570304328a568">tempest-ServerRescueNegativeTestJSON-2104819576</nova:project>
Aug 26 14:40:14 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:14 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:40:14 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:14 user nova-compute[73052]:         <nova:port uuid="b3728317-0c63-410c-bdb3-60166f01310d">
Aug 26 14:40:14 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 14:40:14 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:14 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:14 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:14 user nova-compute[73052]:   </metadata>
Aug 26 14:40:14 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:14 user nova-compute[73052]:     <system>
Aug 26 14:40:14 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:14 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:14 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:14 user nova-compute[73052]:       <entry name="serial">eb6033f4-da59-4900-a67f-1e244631f046</entry>
Aug 26 14:40:14 user nova-compute[73052]:       <entry name="uuid">eb6033f4-da59-4900-a67f-1e244631f046</entry>
Aug 26 14:40:14 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:14 user nova-compute[73052]:     </system>
Aug 26 14:40:14 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:14 user nova-compute[73052]:   <os>
Aug 26 14:40:14 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:14 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:14 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:14 user nova-compute[73052]:   </os>
Aug 26 14:40:14 user nova-compute[73052]:   <features>
Aug 26 14:40:14 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:14 user nova-compute[73052]:     <apic/>
Aug 26 14:40:14 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:14 user nova-compute[73052]:   </features>
Aug 26 14:40:14 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:14 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:14 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:14 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:14 user nova-compute[73052]:   </clock>
Aug 26 14:40:14 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:14 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:14 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:14 user nova-compute[73052]:   </cpu>
Aug 26 14:40:14 user nova-compute[73052]:   <devices>
Aug 26 14:40:14 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:14 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:14 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk"/>
Aug 26 14:40:14 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:40:14 user nova-compute[73052]:     </disk>
Aug 26 14:40:14 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:14 user nova-compute[73052]:       <mac address="fa:16:3e:3e:05:1e"/>
Aug 26 14:40:14 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:14 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:14 user nova-compute[73052]:       <target dev="tapb3728317-0c"/>
Aug 26 14:40:14 user nova-compute[73052]:     </interface>
Aug 26 14:40:14 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:14 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/console.log" append="off"/>
Aug 26 14:40:14 user nova-compute[73052]:     </serial>
Aug 26 14:40:14 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:14 user nova-compute[73052]:     <video>
Aug 26 14:40:14 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:14 user nova-compute[73052]:     </video>
Aug 26 14:40:14 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:14 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:14 user nova-compute[73052]:     </rng>
Aug 26 14:40:14 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:14 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:14 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:14 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:14 user nova-compute[73052]:   </devices>
Aug 26 14:40:14 user nova-compute[73052]: </domain>
Aug 26 14:40:14 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-245647396',display_name='tempest-ServerRescueNegativeTestJSON-server-245647396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-245647396',id=3,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-skvo5tlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:07Z,user_data=None,user_id='966347969be04bb9a69cbdc441a94d8f',uuid=eb6033f4-da59-4900-a67f-1e244631f046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=b3728317-0c63-410c-bdb3-60166f01310d,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3728317-0c') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG os_vif [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=b3728317-0c63-410c-bdb3-60166f01310d,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3728317-0c') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3728317-0c, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3728317-0c, col_values=(('external_ids', {'iface-id': 'b3728317-0c63-410c-bdb3-60166f01310d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:05:1e', 'vm-uuid': 'eb6033f4-da59-4900-a67f-1e244631f046'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:14 user nova-compute[73052]: INFO os_vif [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=b3728317-0c63-410c-bdb3-60166f01310d,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3728317-0c')
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No VIF found with MAC fa:16:3e:3e:05:1e, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-6d855aaf-3355-423e-9d2d-705f6e2c7b21 req-de1ecf27-5222-4f8f-976c-5cdb7a6cd243 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-changed-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-6d855aaf-3355-423e-9d2d-705f6e2c7b21 req-de1ecf27-5222-4f8f-976c-5cdb7a6cd243 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Refreshing instance network info cache due to event network-changed-f87904f2-9bd7-46dd-a11b-4d870fbec13c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6d855aaf-3355-423e-9d2d-705f6e2c7b21 req-de1ecf27-5222-4f8f-976c-5cdb7a6cd243 service nova] Acquiring lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating instance_info_cache with network_info: [{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Releasing lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance network_info: |[{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6d855aaf-3355-423e-9d2d-705f6e2c7b21 req-de1ecf27-5222-4f8f-976c-5cdb7a6cd243 service nova] Acquired lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-6d855aaf-3355-423e-9d2d-705f6e2c7b21 req-de1ecf27-5222-4f8f-976c-5cdb7a6cd243 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Refreshing network info cache for port f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Start _get_guest_xml network_info=[{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-488685255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-488685255',id=4,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3cf/nvxU1Q29x5etLTVRN/RQ0wT00lkZrqCUh0RYM7B4g67X/Lm72+DTghGliuZNzJ1HowMsSVP1RrPf2CC7oVhh1MBM7ZbVELfw80KWM8UIMDpmP/zDX6Kpg0pvIixg==',key_name='tempest-keypair-856206061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-qy7djzrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=2e4f1fd3-d09f-4f6e-abda-9db2158eb46c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.objects.instance [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:15 user nova-compute[73052]:   <uuid>2e4f1fd3-d09f-4f6e-abda-9db2158eb46c</uuid>
Aug 26 14:40:15 user nova-compute[73052]:   <name>instance-00000004</name>
Aug 26 14:40:15 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:15 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:15 user nova-compute[73052]:   <metadata>
Aug 26 14:40:15 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:15 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:15 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-488685255</nova:name>
Aug 26 14:40:15 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:15</nova:creationTime>
Aug 26 14:40:15 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:15 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:15 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:15 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:15 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:15 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:15 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:15 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:15 user nova-compute[73052]:         <nova:user uuid="e2513642eea3411b9c8c33714bd2f3b3">tempest-AttachVolumeShelveTestJSON-1914851903-project-member</nova:user>
Aug 26 14:40:15 user nova-compute[73052]:         <nova:project uuid="267e3757f3624d869a2e5e3d31376b5c">tempest-AttachVolumeShelveTestJSON-1914851903</nova:project>
Aug 26 14:40:15 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:15 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:40:15 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:15 user nova-compute[73052]:         <nova:port uuid="f87904f2-9bd7-46dd-a11b-4d870fbec13c">
Aug 26 14:40:15 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 14:40:15 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:15 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:15 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:15 user nova-compute[73052]:   </metadata>
Aug 26 14:40:15 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:15 user nova-compute[73052]:     <system>
Aug 26 14:40:15 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:15 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:15 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:15 user nova-compute[73052]:       <entry name="serial">2e4f1fd3-d09f-4f6e-abda-9db2158eb46c</entry>
Aug 26 14:40:15 user nova-compute[73052]:       <entry name="uuid">2e4f1fd3-d09f-4f6e-abda-9db2158eb46c</entry>
Aug 26 14:40:15 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:15 user nova-compute[73052]:     </system>
Aug 26 14:40:15 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:15 user nova-compute[73052]:   <os>
Aug 26 14:40:15 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:15 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:15 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:15 user nova-compute[73052]:   </os>
Aug 26 14:40:15 user nova-compute[73052]:   <features>
Aug 26 14:40:15 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:15 user nova-compute[73052]:     <apic/>
Aug 26 14:40:15 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:15 user nova-compute[73052]:   </features>
Aug 26 14:40:15 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:15 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:15 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:15 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:15 user nova-compute[73052]:   </clock>
Aug 26 14:40:15 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:15 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:15 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:15 user nova-compute[73052]:   </cpu>
Aug 26 14:40:15 user nova-compute[73052]:   <devices>
Aug 26 14:40:15 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:15 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:15 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk"/>
Aug 26 14:40:15 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:40:15 user nova-compute[73052]:     </disk>
Aug 26 14:40:15 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:15 user nova-compute[73052]:       <mac address="fa:16:3e:fb:18:36"/>
Aug 26 14:40:15 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:15 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:15 user nova-compute[73052]:       <target dev="tapf87904f2-9b"/>
Aug 26 14:40:15 user nova-compute[73052]:     </interface>
Aug 26 14:40:15 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:15 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/console.log" append="off"/>
Aug 26 14:40:15 user nova-compute[73052]:     </serial>
Aug 26 14:40:15 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:15 user nova-compute[73052]:     <video>
Aug 26 14:40:15 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:15 user nova-compute[73052]:     </video>
Aug 26 14:40:15 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:15 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:15 user nova-compute[73052]:     </rng>
Aug 26 14:40:15 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:15 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:15 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:15 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:15 user nova-compute[73052]:   </devices>
Aug 26 14:40:15 user nova-compute[73052]: </domain>
Aug 26 14:40:15 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-488685255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-488685255',id=4,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3cf/nvxU1Q29x5etLTVRN/RQ0wT00lkZrqCUh0RYM7B4g67X/Lm72+DTghGliuZNzJ1HowMsSVP1RrPf2CC7oVhh1MBM7ZbVELfw80KWM8UIMDpmP/zDX6Kpg0pvIixg==',key_name='tempest-keypair-856206061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-qy7djzrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=2e4f1fd3-d09f-4f6e-abda-9db2158eb46c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG os_vif [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf87904f2-9b, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf87904f2-9b, col_values=(('external_ids', {'iface-id': 'f87904f2-9bd7-46dd-a11b-4d870fbec13c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:18:36', 'vm-uuid': '2e4f1fd3-d09f-4f6e-abda-9db2158eb46c'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:15 user nova-compute[73052]: INFO os_vif [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b')
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No VIF found with MAC fa:16:3e:fb:18:36, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-bdc579b1-be87-403d-8be4-72dabce80e11 req-ea55a8d4-89ba-4655-a18f-3183814a36ca service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updated VIF entry in instance network info cache for port b3728317-0c63-410c-bdb3-60166f01310d. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-bdc579b1-be87-403d-8be4-72dabce80e11 req-ea55a8d4-89ba-4655-a18f-3183814a36ca service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updating instance_info_cache with network_info: [{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bdc579b1-be87-403d-8be4-72dabce80e11 req-ea55a8d4-89ba-4655-a18f-3183814a36ca service nova] Releasing lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG nova.network.neutron [req-6d855aaf-3355-423e-9d2d-705f6e2c7b21 req-de1ecf27-5222-4f8f-976c-5cdb7a6cd243 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updated VIF entry in instance network info cache for port f87904f2-9bd7-46dd-a11b-4d870fbec13c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG nova.network.neutron [req-6d855aaf-3355-423e-9d2d-705f6e2c7b21 req-de1ecf27-5222-4f8f-976c-5cdb7a6cd243 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating instance_info_cache with network_info: [{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6d855aaf-3355-423e-9d2d-705f6e2c7b21 req-de1ecf27-5222-4f8f-976c-5cdb7a6cd243 service nova] Releasing lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060820.7576432, eb6033f4-da59-4900-a67f-1e244631f046 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] VM Resumed (Lifecycle Event)
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Instance spawned successfully.
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060820.7630956, eb6033f4-da59-4900-a67f-1e244631f046 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] VM Started (Lifecycle Event)
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060820.927862, 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] VM Resumed (Lifecycle Event)
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance spawned successfully.
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:20 user nova-compute[73052]: INFO nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Took 14.27 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:21 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060820.935097, 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:21 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] VM Started (Lifecycle Event)
Aug 26 14:40:21 user nova-compute[73052]: INFO nova.compute.manager [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Took 15.19 seconds to build instance.
Aug 26 14:40:21 user nova-compute[73052]: INFO nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Took 13.83 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-246bc68e-896f-4272-8e94-34e7aab74091 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "eb6033f4-da59-4900-a67f-1e244631f046" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.487s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:21 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:21 user nova-compute[73052]: INFO nova.compute.manager [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Took 15.26 seconds to build instance.
Aug 26 14:40:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fd71f73d-5923-4381-9b3e-ce9bd7a792fd tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.395s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:40:30 user nova-compute[73052]: INFO nova.compute.claims [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Claim successful on node user
Aug 26 14:40:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.704s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:40:30 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:40:31 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:40:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:40:31 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Creating image(s)
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "/opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "/opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "/opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.223s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG nova.policy [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b571c97da94649df99b6b7c930b4b372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6da93fd12c047348044fdc3eebd776d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.296s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk 1073741824" returned: 0 in 0.074s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-7998ef65-4844-45d3-9413-eaeb8b99342c req-48815547-9862-4eb2-9195-3e82b0429a26 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7998ef65-4844-45d3-9413-eaeb8b99342c req-48815547-9862-4eb2-9195-3e82b0429a26 service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7998ef65-4844-45d3-9413-eaeb8b99342c req-48815547-9862-4eb2-9195-3e82b0429a26 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7998ef65-4844-45d3-9413-eaeb8b99342c req-48815547-9862-4eb2-9195-3e82b0429a26 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-7998ef65-4844-45d3-9413-eaeb8b99342c req-48815547-9862-4eb2-9195-3e82b0429a26 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:31 user nova-compute[73052]: WARNING nova.compute.manager [req-7998ef65-4844-45d3-9413-eaeb8b99342c req-48815547-9862-4eb2-9195-3e82b0429a26 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state active and task_state None.
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:40:32 user nova-compute[73052]: INFO nova.compute.claims [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Claim successful on node user
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.209s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Cannot resize image /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Ensure instance console log exists: /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:40:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Successfully created port: 12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.policy [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d0e6376d89d498db22fccd1ce9da246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0341c594e4a6890624f3edd2e3349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:40:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Creating image(s)
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "/opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "/opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "/opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "46aa67052a5f33fc06e7a8522f1c99807b04b8dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "46aa67052a5f33fc06e7a8522f1c99807b04b8dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc.part --force-share --output=json" returned: 0 in 0.210s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:33 user nova-compute[73052]: DEBUG nova.virt.images [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] aebb908d-bf2c-4713-9c9c-2f8383ed9801 was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 14:40:33 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:40:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc.part /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-997e2fdb-3d2a-46cd-8fa9-f708c9d0c4c2 req-93fca574-7624-48f3-9199-302245d38a4f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-997e2fdb-3d2a-46cd-8fa9-f708c9d0c4c2 req-93fca574-7624-48f3-9199-302245d38a4f service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-997e2fdb-3d2a-46cd-8fa9-f708c9d0c4c2 req-93fca574-7624-48f3-9199-302245d38a4f service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-997e2fdb-3d2a-46cd-8fa9-f708c9d0c4c2 req-93fca574-7624-48f3-9199-302245d38a4f service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-997e2fdb-3d2a-46cd-8fa9-f708c9d0c4c2 req-93fca574-7624-48f3-9199-302245d38a4f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:34 user nova-compute[73052]: WARNING nova.compute.manager [req-997e2fdb-3d2a-46cd-8fa9-f708c9d0c4c2 req-93fca574-7624-48f3-9199-302245d38a4f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state active and task_state None.
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc.part /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc.converted" returned: 0 in 0.246s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "46aa67052a5f33fc06e7a8522f1c99807b04b8dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.349s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-b8928c32-d3b0-45e8-80f0-ca0760211c78 req-98abb761-442e-4b26-9e4f-484d2c15fbda service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received event network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8928c32-d3b0-45e8-80f0-ca0760211c78 req-98abb761-442e-4b26-9e4f-484d2c15fbda service nova] Acquiring lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8928c32-d3b0-45e8-80f0-ca0760211c78 req-98abb761-442e-4b26-9e4f-484d2c15fbda service nova] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8928c32-d3b0-45e8-80f0-ca0760211c78 req-98abb761-442e-4b26-9e4f-484d2c15fbda service nova] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-b8928c32-d3b0-45e8-80f0-ca0760211c78 req-98abb761-442e-4b26-9e4f-484d2c15fbda service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] No waiting events found dispatching network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:34 user nova-compute[73052]: WARNING nova.compute.manager [req-b8928c32-d3b0-45e8-80f0-ca0760211c78 req-98abb761-442e-4b26-9e4f-484d2c15fbda service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received unexpected event network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f for instance with vm_state active and task_state None.
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "46aa67052a5f33fc06e7a8522f1c99807b04b8dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "46aa67052a5f33fc06e7a8522f1c99807b04b8dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc --force-share --output=json" returned: 0 in 0.223s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc,backing_fmt=raw /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc,backing_fmt=raw /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk 1073741824" returned: 0 in 0.066s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "46aa67052a5f33fc06e7a8522f1c99807b04b8dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc --force-share --output=json" returned: 0 in 0.255s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Successfully created port: 16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Cannot resize image /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Ensure instance console log exists: /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:35 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:40:35 user nova-compute[73052]: INFO nova.compute.claims [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Claim successful on node user
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Successfully updated port: 12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquired lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:40:36 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received event network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] Acquiring lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] No waiting events found dispatching network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:36 user nova-compute[73052]: WARNING nova.compute.manager [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received unexpected event network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f for instance with vm_state active and task_state None.
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received event network-changed-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Refreshing instance network info cache due to event network-changed-12ae594b-302d-483b-8832-eb05dae17537. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] Acquiring lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.policy [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67f2f57480264fc5b15f17f7f94fc1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176dded2fa8441a194f131cbe8a4eefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:40:36 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Creating image(s)
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.198s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.220s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updating instance_info_cache with network_info: [{"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk 1073741824" returned: 0 in 0.066s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Releasing lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Instance network_info: |[{"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] Acquired lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.network.neutron [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Refreshing network info cache for port 12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Start _get_guest_xml network_info=[{"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:37 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:37 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2045442147',display_name='tempest-VolumesAdminNegativeTest-server-2045442147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2045442147',id=5,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtbmrmD+VKYCcZjo87SbJEBrUxDUn9Sv+M5TAiSDPaDMUC1bqfQuZa7l9zw+3LpAM/yFcMZoK5hTvAwGrjrVDP4FOySTkB5fF3C/RviWSwX7Xo66s+xMCJZ+8U7HHWeQw==',key_name='tempest-keypair-362619017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6da93fd12c047348044fdc3eebd776d',ramdisk_id='',reservation_id='r-mzkj8lp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1985528216',owner_user_name='tempest-VolumesAdminNegativeTest-1985528216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b571c97da94649df99b6b7c930b4b372',uuid=acb26430-b816-4969-b379-720e98cf59e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converting VIF {"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:3b:26,bridge_name='br-int',has_traffic_filtering=True,id=12ae594b-302d-483b-8832-eb05dae17537,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ae594b-30') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.objects.instance [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lazy-loading 'pci_devices' on Instance uuid acb26430-b816-4969-b379-720e98cf59e6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:37 user nova-compute[73052]:   <uuid>acb26430-b816-4969-b379-720e98cf59e6</uuid>
Aug 26 14:40:37 user nova-compute[73052]:   <name>instance-00000005</name>
Aug 26 14:40:37 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:37 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:37 user nova-compute[73052]:   <metadata>
Aug 26 14:40:37 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:37 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:37 user nova-compute[73052]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2045442147</nova:name>
Aug 26 14:40:37 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:37</nova:creationTime>
Aug 26 14:40:37 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:37 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:37 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:37 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:37 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:37 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:37 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:37 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:37 user nova-compute[73052]:         <nova:user uuid="b571c97da94649df99b6b7c930b4b372">tempest-VolumesAdminNegativeTest-1985528216-project-member</nova:user>
Aug 26 14:40:37 user nova-compute[73052]:         <nova:project uuid="e6da93fd12c047348044fdc3eebd776d">tempest-VolumesAdminNegativeTest-1985528216</nova:project>
Aug 26 14:40:37 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:37 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:40:37 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:37 user nova-compute[73052]:         <nova:port uuid="12ae594b-302d-483b-8832-eb05dae17537">
Aug 26 14:40:37 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 14:40:37 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:37 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:37 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:37 user nova-compute[73052]:   </metadata>
Aug 26 14:40:37 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:37 user nova-compute[73052]:     <system>
Aug 26 14:40:37 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:37 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:37 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:37 user nova-compute[73052]:       <entry name="serial">acb26430-b816-4969-b379-720e98cf59e6</entry>
Aug 26 14:40:37 user nova-compute[73052]:       <entry name="uuid">acb26430-b816-4969-b379-720e98cf59e6</entry>
Aug 26 14:40:37 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:37 user nova-compute[73052]:     </system>
Aug 26 14:40:37 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:37 user nova-compute[73052]:   <os>
Aug 26 14:40:37 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:37 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:37 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:37 user nova-compute[73052]:   </os>
Aug 26 14:40:37 user nova-compute[73052]:   <features>
Aug 26 14:40:37 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:37 user nova-compute[73052]:     <apic/>
Aug 26 14:40:37 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:37 user nova-compute[73052]:   </features>
Aug 26 14:40:37 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:37 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:37 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:37 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:37 user nova-compute[73052]:   </clock>
Aug 26 14:40:37 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:37 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:37 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:37 user nova-compute[73052]:   </cpu>
Aug 26 14:40:37 user nova-compute[73052]:   <devices>
Aug 26 14:40:37 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:37 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:37 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk"/>
Aug 26 14:40:37 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:40:37 user nova-compute[73052]:     </disk>
Aug 26 14:40:37 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:37 user nova-compute[73052]:       <mac address="fa:16:3e:11:3b:26"/>
Aug 26 14:40:37 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:37 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:37 user nova-compute[73052]:       <target dev="tap12ae594b-30"/>
Aug 26 14:40:37 user nova-compute[73052]:     </interface>
Aug 26 14:40:37 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:37 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/console.log" append="off"/>
Aug 26 14:40:37 user nova-compute[73052]:     </serial>
Aug 26 14:40:37 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:37 user nova-compute[73052]:     <video>
Aug 26 14:40:37 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:37 user nova-compute[73052]:     </video>
Aug 26 14:40:37 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:37 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:37 user nova-compute[73052]:     </rng>
Aug 26 14:40:37 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:37 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:37 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:37 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:37 user nova-compute[73052]:   </devices>
Aug 26 14:40:37 user nova-compute[73052]: </domain>
Aug 26 14:40:37 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2045442147',display_name='tempest-VolumesAdminNegativeTest-server-2045442147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2045442147',id=5,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtbmrmD+VKYCcZjo87SbJEBrUxDUn9Sv+M5TAiSDPaDMUC1bqfQuZa7l9zw+3LpAM/yFcMZoK5hTvAwGrjrVDP4FOySTkB5fF3C/RviWSwX7Xo66s+xMCJZ+8U7HHWeQw==',key_name='tempest-keypair-362619017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6da93fd12c047348044fdc3eebd776d',ramdisk_id='',reservation_id='r-mzkj8lp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1985528216',owner_user_name='tempest-VolumesAdminNegativeTest-1985528216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b571c97da94649df99b6b7c930b4b372',uuid=acb26430-b816-4969-b379-720e98cf59e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converting VIF {"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:3b:26,bridge_name='br-int',has_traffic_filtering=True,id=12ae594b-302d-483b-8832-eb05dae17537,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ae594b-30') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG os_vif [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:3b:26,bridge_name='br-int',has_traffic_filtering=True,id=12ae594b-302d-483b-8832-eb05dae17537,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ae594b-30') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12ae594b-30, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12ae594b-30, col_values=(('external_ids', {'iface-id': '12ae594b-302d-483b-8832-eb05dae17537', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:3b:26', 'vm-uuid': 'acb26430-b816-4969-b379-720e98cf59e6'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:37 user nova-compute[73052]: INFO os_vif [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:3b:26,bridge_name='br-int',has_traffic_filtering=True,id=12ae594b-302d-483b-8832-eb05dae17537,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ae594b-30')
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.316s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Successfully created port: 64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] No VIF found with MAC fa:16:3e:11:3b:26, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Cannot resize image /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Ensure instance console log exists: /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:40:38 user nova-compute[73052]: INFO nova.compute.claims [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Claim successful on node user
Aug 26 14:40:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Successfully updated port: 64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquired lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Successfully updated port: 16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-7d9ee72b-acab-4693-90a3-643282558f59 req-06af32d1-0dee-4b79-91a8-299f81fa9f68 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-changed-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-7d9ee72b-acab-4693-90a3-643282558f59 req-06af32d1-0dee-4b79-91a8-299f81fa9f68 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Refreshing instance network info cache due to event network-changed-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7d9ee72b-acab-4693-90a3-643282558f59 req-06af32d1-0dee-4b79-91a8-299f81fa9f68 service nova] Acquiring lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:38 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquired lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-7ad2ca4b-9db3-479e-9e65-22432d30c6ed req-44e8c8a7-c9b8-4963-b760-f79ea5ccddc0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received event network-changed-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-7ad2ca4b-9db3-479e-9e65-22432d30c6ed req-44e8c8a7-c9b8-4963-b760-f79ea5ccddc0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Refreshing instance network info cache due to event network-changed-16c5ce06-c50f-443d-9bb8-884fe5e5c929. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ad2ca4b-9db3-479e-9e65-22432d30c6ed req-44e8c8a7-c9b8-4963-b760-f79ea5ccddc0 service nova] Acquiring lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updated VIF entry in instance network info cache for port 12ae594b-302d-483b-8832-eb05dae17537. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updating instance_info_cache with network_info: [{"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b0a4fce-9fac-434d-810a-82fcfd039d05 req-a3ffd03e-20ed-4b83-a803-2278dbb578ff service nova] Releasing lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating instance_info_cache with network_info: [{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:40:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Creating image(s)
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "/opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "/opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.policy [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a70dd0e1eafe42b681bc51959b3e6dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4ef05432dd4b59b77840cb11ddf674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Releasing lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Instance network_info: |[{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7d9ee72b-acab-4693-90a3-643282558f59 req-06af32d1-0dee-4b79-91a8-299f81fa9f68 service nova] Acquired lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-7d9ee72b-acab-4693-90a3-643282558f59 req-06af32d1-0dee-4b79-91a8-299f81fa9f68 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Refreshing network info cache for port 64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Start _get_guest_xml network_info=[{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:39 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:39 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converting VIF {"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:74:c4,bridge_name='br-int',has_traffic_filtering=True,id=64d1aab0-95f3-4ac4-bb41-cc97c1d5365e,network=Network(b054fa94-66bc-4835-9750-5f8b12b5a621),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1aab0-95') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.objects.instance [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lazy-loading 'pci_devices' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.210s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:39 user nova-compute[73052]:   <uuid>55971d31-4c54-4150-bfbd-4636df306fbd</uuid>
Aug 26 14:40:39 user nova-compute[73052]:   <name>instance-00000007</name>
Aug 26 14:40:39 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:39 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:39 user nova-compute[73052]:   <metadata>
Aug 26 14:40:39 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:39 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:39 user nova-compute[73052]:       <nova:name>tempest-device-tagging-server-938538042</nova:name>
Aug 26 14:40:39 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:39</nova:creationTime>
Aug 26 14:40:39 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:39 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:39 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:39 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:39 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:39 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:39 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:39 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:39 user nova-compute[73052]:         <nova:user uuid="67f2f57480264fc5b15f17f7f94fc1a1">tempest-TaggedAttachmentsTest-395402729-project-member</nova:user>
Aug 26 14:40:39 user nova-compute[73052]:         <nova:project uuid="176dded2fa8441a194f131cbe8a4eefe">tempest-TaggedAttachmentsTest-395402729</nova:project>
Aug 26 14:40:39 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:39 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:40:39 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:39 user nova-compute[73052]:         <nova:port uuid="64d1aab0-95f3-4ac4-bb41-cc97c1d5365e">
Aug 26 14:40:39 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:40:39 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:39 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:39 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:39 user nova-compute[73052]:   </metadata>
Aug 26 14:40:39 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:39 user nova-compute[73052]:     <system>
Aug 26 14:40:39 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:39 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:39 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:39 user nova-compute[73052]:       <entry name="serial">55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:40:39 user nova-compute[73052]:       <entry name="uuid">55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:40:39 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:39 user nova-compute[73052]:     </system>
Aug 26 14:40:39 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:39 user nova-compute[73052]:   <os>
Aug 26 14:40:39 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:39 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:39 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:39 user nova-compute[73052]:   </os>
Aug 26 14:40:39 user nova-compute[73052]:   <features>
Aug 26 14:40:39 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:39 user nova-compute[73052]:     <apic/>
Aug 26 14:40:39 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:39 user nova-compute[73052]:   </features>
Aug 26 14:40:39 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:39 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:39 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:39 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:39 user nova-compute[73052]:   </clock>
Aug 26 14:40:39 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:39 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:39 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:39 user nova-compute[73052]:   </cpu>
Aug 26 14:40:39 user nova-compute[73052]:   <devices>
Aug 26 14:40:39 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:39 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:39 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk"/>
Aug 26 14:40:39 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:40:39 user nova-compute[73052]:     </disk>
Aug 26 14:40:39 user nova-compute[73052]:     <disk type="file" device="cdrom">
Aug 26 14:40:39 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 14:40:39 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.config"/>
Aug 26 14:40:39 user nova-compute[73052]:       <target dev="hda" bus="ide"/>
Aug 26 14:40:39 user nova-compute[73052]:     </disk>
Aug 26 14:40:39 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:39 user nova-compute[73052]:       <mac address="fa:16:3e:6e:74:c4"/>
Aug 26 14:40:39 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:39 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:39 user nova-compute[73052]:       <target dev="tap64d1aab0-95"/>
Aug 26 14:40:39 user nova-compute[73052]:     </interface>
Aug 26 14:40:39 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:39 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log" append="off"/>
Aug 26 14:40:39 user nova-compute[73052]:     </serial>
Aug 26 14:40:39 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:39 user nova-compute[73052]:     <video>
Aug 26 14:40:39 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:39 user nova-compute[73052]:     </video>
Aug 26 14:40:39 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:39 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:39 user nova-compute[73052]:     </rng>
Aug 26 14:40:39 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:39 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:39 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:39 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:39 user nova-compute[73052]:   </devices>
Aug 26 14:40:39 user nova-compute[73052]: </domain>
Aug 26 14:40:39 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converting VIF {"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:74:c4,bridge_name='br-int',has_traffic_filtering=True,id=64d1aab0-95f3-4ac4-bb41-cc97c1d5365e,network=Network(b054fa94-66bc-4835-9750-5f8b12b5a621),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1aab0-95') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG os_vif [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:74:c4,bridge_name='br-int',has_traffic_filtering=True,id=64d1aab0-95f3-4ac4-bb41-cc97c1d5365e,network=Network(b054fa94-66bc-4835-9750-5f8b12b5a621),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1aab0-95') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64d1aab0-95, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64d1aab0-95, col_values=(('external_ids', {'iface-id': '64d1aab0-95f3-4ac4-bb41-cc97c1d5365e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:74:c4', 'vm-uuid': '55971d31-4c54-4150-bfbd-4636df306fbd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: INFO os_vif [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:74:c4,bridge_name='br-int',has_traffic_filtering=True,id=64d1aab0-95f3-4ac4-bb41-cc97c1d5365e,network=Network(b054fa94-66bc-4835-9750-5f8b12b5a621),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1aab0-95')
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No BDM found with device name hda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No VIF found with MAC fa:16:3e:6e:74:c4, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Using config drive
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.292s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk 1073741824" returned: 0 in 0.102s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Updating instance_info_cache with network_info: [{"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Releasing lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Instance network_info: |[{"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Creating config drive at /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.config
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_d6zd1qo {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ad2ca4b-9db3-479e-9e65-22432d30c6ed req-44e8c8a7-c9b8-4963-b760-f79ea5ccddc0 service nova] Acquired lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-7ad2ca4b-9db3-479e-9e65-22432d30c6ed req-44e8c8a7-c9b8-4963-b760-f79ea5ccddc0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Refreshing network info cache for port 16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Start _get_guest_xml network_info=[{"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:40:23Z,direct_url=<?>,disk_format='qcow2',id=aebb908d-bf2c-4713-9c9c-2f8383ed9801,min_disk=0,min_ram=0,name='',owner='f84a1ada9d554fc68d1577cc03bbfdb0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:40:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'image_id': 'aebb908d-bf2c-4713-9c9c-2f8383ed9801'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.272s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_d6zd1qo" returned: 0 in 0.108s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:40:23Z,direct_url=<?>,disk_format='qcow2',id=aebb908d-bf2c-4713-9c9c-2f8383ed9801,min_disk=0,min_ram=0,name='',owner='f84a1ada9d554fc68d1577cc03bbfdb0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:40:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-130769244',display_name='tempest-AttachSCSIVolumeTestJSON-server-130769244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-130769244',id=6,image_ref='aebb908d-bf2c-4713-9c9c-2f8383ed9801',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsUK9uWiRbXsWXRrSAynWP4F0XdQ3hwCBrhU8PXLHZqWDQWYe/U6Hnh7F2x0gw5EjFyzmYclzQv8fVI9abRlPV7MMHGWoDPQc0OaDnwV5yP3FPcYvSrJi0NavD1KoSorg==',key_name='tempest-keypair-277411448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61b0341c594e4a6890624f3edd2e3349',ramdisk_id='',reservation_id='r-bzcxili8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='aebb908d-bf2c-4713-9c9c-2f8383ed9801',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1155282523',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1155282523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d0e6376d89d498db22fccd1ce9da246',uuid=af3029db-dce7-4f4e-b907-630ac9ff72d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Converting VIF {"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:70:19,bridge_name='br-int',has_traffic_filtering=True,id=16c5ce06-c50f-443d-9bb8-884fe5e5c929,network=Network(0b073da5-6268-4b27-b9fa-1ec1a218ef77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c5ce06-c5') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lazy-loading 'pci_devices' on Instance uuid af3029db-dce7-4f4e-b907-630ac9ff72d0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-7d9ee72b-acab-4693-90a3-643282558f59 req-06af32d1-0dee-4b79-91a8-299f81fa9f68 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updated VIF entry in instance network info cache for port 64d1aab0-95f3-4ac4-bb41-cc97c1d5365e. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-7d9ee72b-acab-4693-90a3-643282558f59 req-06af32d1-0dee-4b79-91a8-299f81fa9f68 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating instance_info_cache with network_info: [{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:40 user nova-compute[73052]:   <uuid>af3029db-dce7-4f4e-b907-630ac9ff72d0</uuid>
Aug 26 14:40:40 user nova-compute[73052]:   <name>instance-00000006</name>
Aug 26 14:40:40 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:40 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:40 user nova-compute[73052]:   <metadata>
Aug 26 14:40:40 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:40 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:40 user nova-compute[73052]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-130769244</nova:name>
Aug 26 14:40:40 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:40</nova:creationTime>
Aug 26 14:40:40 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:40 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:40 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:40 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:40 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:40 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:40 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:40 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:40 user nova-compute[73052]:         <nova:user uuid="6d0e6376d89d498db22fccd1ce9da246">tempest-AttachSCSIVolumeTestJSON-1155282523-project-member</nova:user>
Aug 26 14:40:40 user nova-compute[73052]:         <nova:project uuid="61b0341c594e4a6890624f3edd2e3349">tempest-AttachSCSIVolumeTestJSON-1155282523</nova:project>
Aug 26 14:40:40 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:40 user nova-compute[73052]:       <nova:root type="image" uuid="aebb908d-bf2c-4713-9c9c-2f8383ed9801"/>
Aug 26 14:40:40 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:40 user nova-compute[73052]:         <nova:port uuid="16c5ce06-c50f-443d-9bb8-884fe5e5c929">
Aug 26 14:40:40 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 14:40:40 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:40 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:40 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:40 user nova-compute[73052]:   </metadata>
Aug 26 14:40:40 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:40 user nova-compute[73052]:     <system>
Aug 26 14:40:40 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:40 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:40 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:40 user nova-compute[73052]:       <entry name="serial">af3029db-dce7-4f4e-b907-630ac9ff72d0</entry>
Aug 26 14:40:40 user nova-compute[73052]:       <entry name="uuid">af3029db-dce7-4f4e-b907-630ac9ff72d0</entry>
Aug 26 14:40:40 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:40 user nova-compute[73052]:     </system>
Aug 26 14:40:40 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:40 user nova-compute[73052]:   <os>
Aug 26 14:40:40 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:40 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:40 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:40 user nova-compute[73052]:   </os>
Aug 26 14:40:40 user nova-compute[73052]:   <features>
Aug 26 14:40:40 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:40 user nova-compute[73052]:     <apic/>
Aug 26 14:40:40 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:40 user nova-compute[73052]:   </features>
Aug 26 14:40:40 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:40 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:40 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:40 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:40 user nova-compute[73052]:   </clock>
Aug 26 14:40:40 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:40 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:40 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:40 user nova-compute[73052]:   </cpu>
Aug 26 14:40:40 user nova-compute[73052]:   <devices>
Aug 26 14:40:40 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:40 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:40 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk"/>
Aug 26 14:40:40 user nova-compute[73052]:       <target dev="sda" bus="scsi"/>
Aug 26 14:40:40 user nova-compute[73052]:       <address type="drive" controller="0" unit="0"/>
Aug 26 14:40:40 user nova-compute[73052]:     </disk>
Aug 26 14:40:40 user nova-compute[73052]:     <disk type="file" device="cdrom">
Aug 26 14:40:40 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 14:40:40 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk.config"/>
Aug 26 14:40:40 user nova-compute[73052]:       <target dev="sdb" bus="scsi"/>
Aug 26 14:40:40 user nova-compute[73052]:       <address type="drive" controller="0" unit="1"/>
Aug 26 14:40:40 user nova-compute[73052]:     </disk>
Aug 26 14:40:40 user nova-compute[73052]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 14:40:40 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:40 user nova-compute[73052]:       <mac address="fa:16:3e:33:70:19"/>
Aug 26 14:40:40 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:40 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:40 user nova-compute[73052]:       <target dev="tap16c5ce06-c5"/>
Aug 26 14:40:40 user nova-compute[73052]:     </interface>
Aug 26 14:40:40 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:40 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/console.log" append="off"/>
Aug 26 14:40:40 user nova-compute[73052]:     </serial>
Aug 26 14:40:40 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:40 user nova-compute[73052]:     <video>
Aug 26 14:40:40 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:40 user nova-compute[73052]:     </video>
Aug 26 14:40:40 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:40 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:40 user nova-compute[73052]:     </rng>
Aug 26 14:40:40 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:40 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:40 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:40 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:40 user nova-compute[73052]:   </devices>
Aug 26 14:40:40 user nova-compute[73052]: </domain>
Aug 26 14:40:40 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-130769244',display_name='tempest-AttachSCSIVolumeTestJSON-server-130769244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-130769244',id=6,image_ref='aebb908d-bf2c-4713-9c9c-2f8383ed9801',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsUK9uWiRbXsWXRrSAynWP4F0XdQ3hwCBrhU8PXLHZqWDQWYe/U6Hnh7F2x0gw5EjFyzmYclzQv8fVI9abRlPV7MMHGWoDPQc0OaDnwV5yP3FPcYvSrJi0NavD1KoSorg==',key_name='tempest-keypair-277411448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61b0341c594e4a6890624f3edd2e3349',ramdisk_id='',reservation_id='r-bzcxili8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='aebb908d-bf2c-4713-9c9c-2f8383ed9801',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1155282523',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1155282523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d0e6376d89d498db22fccd1ce9da246',uuid=af3029db-dce7-4f4e-b907-630ac9ff72d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Converting VIF {"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:70:19,bridge_name='br-int',has_traffic_filtering=True,id=16c5ce06-c50f-443d-9bb8-884fe5e5c929,network=Network(0b073da5-6268-4b27-b9fa-1ec1a218ef77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c5ce06-c5') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG os_vif [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:70:19,bridge_name='br-int',has_traffic_filtering=True,id=16c5ce06-c50f-443d-9bb8-884fe5e5c929,network=Network(0b073da5-6268-4b27-b9fa-1ec1a218ef77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c5ce06-c5') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7d9ee72b-acab-4693-90a3-643282558f59 req-06af32d1-0dee-4b79-91a8-299f81fa9f68 service nova] Releasing lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16c5ce06-c5, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16c5ce06-c5, col_values=(('external_ids', {'iface-id': '16c5ce06-c50f-443d-9bb8-884fe5e5c929', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:70:19', 'vm-uuid': 'af3029db-dce7-4f4e-b907-630ac9ff72d0'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:40 user nova-compute[73052]: INFO os_vif [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:70:19,bridge_name='br-int',has_traffic_filtering=True,id=16c5ce06-c50f-443d-9bb8-884fe5e5c929,network=Network(0b073da5-6268-4b27-b9fa-1ec1a218ef77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c5ce06-c5')
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Cannot resize image /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Ensure instance console log exists: /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] No BDM found with device name sda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] No VIF found with MAC fa:16:3e:33:70:19, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Using config drive
Aug 26 14:40:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Successfully created port: 53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Creating config drive at /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk.config
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptlg9y8ye {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptlg9y8ye" returned: 0 in 0.065s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-7ad2ca4b-9db3-479e-9e65-22432d30c6ed req-44e8c8a7-c9b8-4963-b760-f79ea5ccddc0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Updated VIF entry in instance network info cache for port 16c5ce06-c50f-443d-9bb8-884fe5e5c929. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-7ad2ca4b-9db3-479e-9e65-22432d30c6ed req-44e8c8a7-c9b8-4963-b760-f79ea5ccddc0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Updating instance_info_cache with network_info: [{"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ad2ca4b-9db3-479e-9e65-22432d30c6ed req-44e8c8a7-c9b8-4963-b760-f79ea5ccddc0 service nova] Releasing lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Successfully updated port: 53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquired lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-af9d5ad5-4bf0-494c-9eb9-bae319c483a3 req-97fcbd62-5f74-43b4-a8db-4bf5c06154f3 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received event network-changed-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-af9d5ad5-4bf0-494c-9eb9-bae319c483a3 req-97fcbd62-5f74-43b4-a8db-4bf5c06154f3 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Refreshing instance network info cache due to event network-changed-53db4fdc-63d5-4ca9-8e60-374c686017fa. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-af9d5ad5-4bf0-494c-9eb9-bae319c483a3 req-97fcbd62-5f74-43b4-a8db-4bf5c06154f3 service nova] Acquiring lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060841.841803, acb26430-b816-4969-b379-720e98cf59e6 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:41 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] VM Resumed (Lifecycle Event)
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: acb26430-b816-4969-b379-720e98cf59e6] Instance spawned successfully.
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:41 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060841.8420918, acb26430-b816-4969-b379-720e98cf59e6 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:41 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] VM Started (Lifecycle Event)
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:42 user nova-compute[73052]: INFO nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Took 10.75 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:42 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.network.neutron [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Updating instance_info_cache with network_info: [{"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Releasing lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Instance network_info: |[{"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-af9d5ad5-4bf0-494c-9eb9-bae319c483a3 req-97fcbd62-5f74-43b4-a8db-4bf5c06154f3 service nova] Acquired lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-af9d5ad5-4bf0-494c-9eb9-bae319c483a3 req-97fcbd62-5f74-43b4-a8db-4bf5c06154f3 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Refreshing network info cache for port 53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Start _get_guest_xml network_info=[{"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:42 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:42 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-407864732',display_name='tempest-TestVolumeSwap-server-407864732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-407864732',id=8,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPxr7J2yNWdJoquoOjHgzTgx5OIc5VT7qbHnWGW2AxUn3jMi07q9ZE84b4BC0km5PzwEI7I9T/IcV1b28YQ/YOmUxzIAhA4XCxNAQz70T8oOfPVJLkAJ8BynWfzDZy57w==',key_name='tempest-keypair-1624247600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c4ef05432dd4b59b77840cb11ddf674',ramdisk_id='',reservation_id='r-dwzvkj60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1983575140',owner_user_name='tempest-TestVolumeSwap-1983575140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70dd0e1eafe42b681bc51959b3e6dc9',uuid=fc07b8f2-3c64-4de9-a0a4-55121f6a90c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Converting VIF {"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:dd:cc,bridge_name='br-int',has_traffic_filtering=True,id=53db4fdc-63d5-4ca9-8e60-374c686017fa,network=Network(2152ed68-4b5b-47e2-a0ab-e56d2aac419f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53db4fdc-63') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lazy-loading 'pci_devices' on Instance uuid fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:42 user nova-compute[73052]: INFO nova.compute.manager [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Took 12.12 seconds to build instance.
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:42 user nova-compute[73052]:   <uuid>fc07b8f2-3c64-4de9-a0a4-55121f6a90c9</uuid>
Aug 26 14:40:42 user nova-compute[73052]:   <name>instance-00000008</name>
Aug 26 14:40:42 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:42 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:42 user nova-compute[73052]:   <metadata>
Aug 26 14:40:42 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:42 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:42 user nova-compute[73052]:       <nova:name>tempest-TestVolumeSwap-server-407864732</nova:name>
Aug 26 14:40:42 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:42</nova:creationTime>
Aug 26 14:40:42 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:42 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:42 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:42 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:42 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:42 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:42 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:42 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:42 user nova-compute[73052]:         <nova:user uuid="a70dd0e1eafe42b681bc51959b3e6dc9">tempest-TestVolumeSwap-1983575140-project-member</nova:user>
Aug 26 14:40:42 user nova-compute[73052]:         <nova:project uuid="6c4ef05432dd4b59b77840cb11ddf674">tempest-TestVolumeSwap-1983575140</nova:project>
Aug 26 14:40:42 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:42 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:40:42 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:42 user nova-compute[73052]:         <nova:port uuid="53db4fdc-63d5-4ca9-8e60-374c686017fa">
Aug 26 14:40:42 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 14:40:42 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:42 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:42 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:42 user nova-compute[73052]:   </metadata>
Aug 26 14:40:42 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:42 user nova-compute[73052]:     <system>
Aug 26 14:40:42 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:42 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:42 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:42 user nova-compute[73052]:       <entry name="serial">fc07b8f2-3c64-4de9-a0a4-55121f6a90c9</entry>
Aug 26 14:40:42 user nova-compute[73052]:       <entry name="uuid">fc07b8f2-3c64-4de9-a0a4-55121f6a90c9</entry>
Aug 26 14:40:42 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:42 user nova-compute[73052]:     </system>
Aug 26 14:40:42 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:42 user nova-compute[73052]:   <os>
Aug 26 14:40:42 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:42 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:42 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:42 user nova-compute[73052]:   </os>
Aug 26 14:40:42 user nova-compute[73052]:   <features>
Aug 26 14:40:42 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:42 user nova-compute[73052]:     <apic/>
Aug 26 14:40:42 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:42 user nova-compute[73052]:   </features>
Aug 26 14:40:42 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:42 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:42 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:42 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:42 user nova-compute[73052]:   </clock>
Aug 26 14:40:42 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:42 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:42 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:42 user nova-compute[73052]:   </cpu>
Aug 26 14:40:42 user nova-compute[73052]:   <devices>
Aug 26 14:40:42 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:42 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:42 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk"/>
Aug 26 14:40:42 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:40:42 user nova-compute[73052]:     </disk>
Aug 26 14:40:42 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:42 user nova-compute[73052]:       <mac address="fa:16:3e:20:dd:cc"/>
Aug 26 14:40:42 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:42 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:42 user nova-compute[73052]:       <target dev="tap53db4fdc-63"/>
Aug 26 14:40:42 user nova-compute[73052]:     </interface>
Aug 26 14:40:42 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:42 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/console.log" append="off"/>
Aug 26 14:40:42 user nova-compute[73052]:     </serial>
Aug 26 14:40:42 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:42 user nova-compute[73052]:     <video>
Aug 26 14:40:42 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:42 user nova-compute[73052]:     </video>
Aug 26 14:40:42 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:42 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:42 user nova-compute[73052]:     </rng>
Aug 26 14:40:42 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:42 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:42 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:42 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:42 user nova-compute[73052]:   </devices>
Aug 26 14:40:42 user nova-compute[73052]: </domain>
Aug 26 14:40:42 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-407864732',display_name='tempest-TestVolumeSwap-server-407864732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-407864732',id=8,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPxr7J2yNWdJoquoOjHgzTgx5OIc5VT7qbHnWGW2AxUn3jMi07q9ZE84b4BC0km5PzwEI7I9T/IcV1b28YQ/YOmUxzIAhA4XCxNAQz70T8oOfPVJLkAJ8BynWfzDZy57w==',key_name='tempest-keypair-1624247600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c4ef05432dd4b59b77840cb11ddf674',ramdisk_id='',reservation_id='r-dwzvkj60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1983575140',owner_user_name='tempest-TestVolumeSwap-1983575140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70dd0e1eafe42b681bc51959b3e6dc9',uuid=fc07b8f2-3c64-4de9-a0a4-55121f6a90c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Converting VIF {"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:dd:cc,bridge_name='br-int',has_traffic_filtering=True,id=53db4fdc-63d5-4ca9-8e60-374c686017fa,network=Network(2152ed68-4b5b-47e2-a0ab-e56d2aac419f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53db4fdc-63') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG os_vif [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:dd:cc,bridge_name='br-int',has_traffic_filtering=True,id=53db4fdc-63d5-4ca9-8e60-374c686017fa,network=Network(2152ed68-4b5b-47e2-a0ab-e56d2aac419f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53db4fdc-63') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53db4fdc-63, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53db4fdc-63, col_values=(('external_ids', {'iface-id': '53db4fdc-63d5-4ca9-8e60-374c686017fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:dd:cc', 'vm-uuid': 'fc07b8f2-3c64-4de9-a0a4-55121f6a90c9'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3ff72ba1-76d3-435e-98ac-b0755a641d1e tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.332s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:42 user nova-compute[73052]: INFO os_vif [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:dd:cc,bridge_name='br-int',has_traffic_filtering=True,id=53db4fdc-63d5-4ca9-8e60-374c686017fa,network=Network(2152ed68-4b5b-47e2-a0ab-e56d2aac419f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53db4fdc-63')
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] No VIF found with MAC fa:16:3e:20:dd:cc, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-af9d5ad5-4bf0-494c-9eb9-bae319c483a3 req-97fcbd62-5f74-43b4-a8db-4bf5c06154f3 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Updated VIF entry in instance network info cache for port 53db4fdc-63d5-4ca9-8e60-374c686017fa. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-af9d5ad5-4bf0-494c-9eb9-bae319c483a3 req-97fcbd62-5f74-43b4-a8db-4bf5c06154f3 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Updating instance_info_cache with network_info: [{"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-af9d5ad5-4bf0-494c-9eb9-bae319c483a3 req-97fcbd62-5f74-43b4-a8db-4bf5c06154f3 service nova] Releasing lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:40:43 user nova-compute[73052]: INFO nova.compute.claims [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Claim successful on node user
Aug 26 14:40:43 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:40:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:40:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG nova.policy [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7a90176398446d1ba20ecd6d45eb057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef29871498426e9f410dcea7a3b947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:40:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:40:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Creating image(s)
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "/opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "/opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.225s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.274s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-41ce6a75-39a8-4da9-8dab-363d08212145 req-80c38c1d-e5be-4add-ad95-8e5e69577c28 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-41ce6a75-39a8-4da9-8dab-363d08212145 req-80c38c1d-e5be-4add-ad95-8e5e69577c28 service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-41ce6a75-39a8-4da9-8dab-363d08212145 req-80c38c1d-e5be-4add-ad95-8e5e69577c28 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-41ce6a75-39a8-4da9-8dab-363d08212145 req-80c38c1d-e5be-4add-ad95-8e5e69577c28 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-41ce6a75-39a8-4da9-8dab-363d08212145 req-80c38c1d-e5be-4add-ad95-8e5e69577c28 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:44 user nova-compute[73052]: WARNING nova.compute.manager [req-41ce6a75-39a8-4da9-8dab-363d08212145 req-80c38c1d-e5be-4add-ad95-8e5e69577c28 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e for instance with vm_state building and task_state spawning.
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk 1073741824" returned: 0 in 0.100s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.260s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-2bd939b8-7da1-493f-afb8-ec1c73a34b40 req-d1899f66-f79b-4245-b892-781ca6479b33 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2bd939b8-7da1-493f-afb8-ec1c73a34b40 req-d1899f66-f79b-4245-b892-781ca6479b33 service nova] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2bd939b8-7da1-493f-afb8-ec1c73a34b40 req-d1899f66-f79b-4245-b892-781ca6479b33 service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2bd939b8-7da1-493f-afb8-ec1c73a34b40 req-d1899f66-f79b-4245-b892-781ca6479b33 service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-2bd939b8-7da1-493f-afb8-ec1c73a34b40 req-d1899f66-f79b-4245-b892-781ca6479b33 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] No waiting events found dispatching network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:45 user nova-compute[73052]: WARNING nova.compute.manager [req-2bd939b8-7da1-493f-afb8-ec1c73a34b40 req-d1899f66-f79b-4245-b892-781ca6479b33 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received unexpected event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d for instance with vm_state active and task_state None.
Aug 26 14:40:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Cannot resize image /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Ensure instance console log exists: /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Successfully created port: 91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:46 user nova-compute[73052]: WARNING nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e for instance with vm_state building and task_state spawning.
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received event network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] No waiting events found dispatching network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:46 user nova-compute[73052]: WARNING nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received unexpected event network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 for instance with vm_state building and task_state spawning.
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received event network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] No waiting events found dispatching network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:46 user nova-compute[73052]: WARNING nova.compute.manager [req-bf5186c7-d547-4ea6-9c76-01dda53f34b5 req-c8f777a0-0af2-44c0-9a41-68e7f4dfb5d3 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received unexpected event network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 for instance with vm_state building and task_state spawning.
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 14:40:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Successfully updated port: 91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquired lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] No waiting events found dispatching network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:47 user nova-compute[73052]: WARNING nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received unexpected event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d for instance with vm_state active and task_state None.
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] No waiting events found dispatching network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:47 user nova-compute[73052]: WARNING nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received unexpected event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c for instance with vm_state active and task_state None.
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] No waiting events found dispatching network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:47 user nova-compute[73052]: WARNING nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received unexpected event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c for instance with vm_state active and task_state None.
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received event network-changed-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Refreshing instance network info cache due to event network-changed-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Acquiring lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Updating instance_info_cache with network_info: [{"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Releasing lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Instance network_info: |[{"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Acquired lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.neutron [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Refreshing network info cache for port 91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Start _get_guest_xml network_info=[{"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:40:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1009564263',display_name='tempest-VolumesAssistedSnapshotsTest-server-1009564263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1009564263',id=9,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzFESbEyzBaE81J56bAqNPRL0+9qw9zG1T7JDgJZyYSiTAfINOL8+ST57VFSz03odZdfawp1lEudJqPOyZUNFLetiExzta2iyPGwKUtZ6H61vp0yBnEWB39fNzkBeruvg==',key_name='tempest-keypair-158567399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ef29871498426e9f410dcea7a3b947',ramdisk_id='',reservation_id='r-n2dd77ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1188834628',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1188834628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a90176398446d1ba20ecd6d45eb057',uuid=bb7d8ce2-141a-4ba9-b545-858875307ff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Converting VIF {"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:6b:02,bridge_name='br-int',has_traffic_filtering=True,id=91ba2e98-54ab-4357-b08d-edaf5bf4cfd6,network=Network(dfe0e2b6-32dd-4801-bca4-ddd8944e9474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ba2e98-54') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lazy-loading 'pci_devices' on Instance uuid bb7d8ce2-141a-4ba9-b545-858875307ff0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:40:47 user nova-compute[73052]:   <uuid>bb7d8ce2-141a-4ba9-b545-858875307ff0</uuid>
Aug 26 14:40:47 user nova-compute[73052]:   <name>instance-00000009</name>
Aug 26 14:40:47 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:40:47 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:40:47 user nova-compute[73052]:   <metadata>
Aug 26 14:40:47 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:40:47 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:40:47 user nova-compute[73052]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1009564263</nova:name>
Aug 26 14:40:47 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:40:47</nova:creationTime>
Aug 26 14:40:47 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:40:47 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:40:47 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:40:47 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:40:47 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:40:47 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:40:47 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:40:47 user nova-compute[73052]:       <nova:owner>
Aug 26 14:40:47 user nova-compute[73052]:         <nova:user uuid="b7a90176398446d1ba20ecd6d45eb057">tempest-VolumesAssistedSnapshotsTest-1188834628-project-member</nova:user>
Aug 26 14:40:47 user nova-compute[73052]:         <nova:project uuid="92ef29871498426e9f410dcea7a3b947">tempest-VolumesAssistedSnapshotsTest-1188834628</nova:project>
Aug 26 14:40:47 user nova-compute[73052]:       </nova:owner>
Aug 26 14:40:47 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:40:47 user nova-compute[73052]:       <nova:ports>
Aug 26 14:40:47 user nova-compute[73052]:         <nova:port uuid="91ba2e98-54ab-4357-b08d-edaf5bf4cfd6">
Aug 26 14:40:47 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 14:40:47 user nova-compute[73052]:         </nova:port>
Aug 26 14:40:47 user nova-compute[73052]:       </nova:ports>
Aug 26 14:40:47 user nova-compute[73052]:     </nova:instance>
Aug 26 14:40:47 user nova-compute[73052]:   </metadata>
Aug 26 14:40:47 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:40:47 user nova-compute[73052]:     <system>
Aug 26 14:40:47 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:40:47 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:40:47 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:40:47 user nova-compute[73052]:       <entry name="serial">bb7d8ce2-141a-4ba9-b545-858875307ff0</entry>
Aug 26 14:40:47 user nova-compute[73052]:       <entry name="uuid">bb7d8ce2-141a-4ba9-b545-858875307ff0</entry>
Aug 26 14:40:47 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:40:47 user nova-compute[73052]:     </system>
Aug 26 14:40:47 user nova-compute[73052]:   </sysinfo>
Aug 26 14:40:47 user nova-compute[73052]:   <os>
Aug 26 14:40:47 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:40:47 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:40:47 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:40:47 user nova-compute[73052]:   </os>
Aug 26 14:40:47 user nova-compute[73052]:   <features>
Aug 26 14:40:47 user nova-compute[73052]:     <acpi/>
Aug 26 14:40:47 user nova-compute[73052]:     <apic/>
Aug 26 14:40:47 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:40:47 user nova-compute[73052]:   </features>
Aug 26 14:40:47 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:40:47 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:40:47 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:40:47 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:40:47 user nova-compute[73052]:   </clock>
Aug 26 14:40:47 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:40:47 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:40:47 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:40:47 user nova-compute[73052]:   </cpu>
Aug 26 14:40:47 user nova-compute[73052]:   <devices>
Aug 26 14:40:47 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:40:47 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:40:47 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk"/>
Aug 26 14:40:47 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:40:47 user nova-compute[73052]:     </disk>
Aug 26 14:40:47 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:40:47 user nova-compute[73052]:       <mac address="fa:16:3e:22:6b:02"/>
Aug 26 14:40:47 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:47 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:40:47 user nova-compute[73052]:       <target dev="tap91ba2e98-54"/>
Aug 26 14:40:47 user nova-compute[73052]:     </interface>
Aug 26 14:40:47 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:40:47 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/console.log" append="off"/>
Aug 26 14:40:47 user nova-compute[73052]:     </serial>
Aug 26 14:40:47 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:40:47 user nova-compute[73052]:     <video>
Aug 26 14:40:47 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:40:47 user nova-compute[73052]:     </video>
Aug 26 14:40:47 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:40:47 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:40:47 user nova-compute[73052]:     </rng>
Aug 26 14:40:47 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:40:47 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:40:47 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:40:47 user nova-compute[73052]:     </memballoon>
Aug 26 14:40:47 user nova-compute[73052]:   </devices>
Aug 26 14:40:47 user nova-compute[73052]: </domain>
Aug 26 14:40:47 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1009564263',display_name='tempest-VolumesAssistedSnapshotsTest-server-1009564263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1009564263',id=9,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzFESbEyzBaE81J56bAqNPRL0+9qw9zG1T7JDgJZyYSiTAfINOL8+ST57VFSz03odZdfawp1lEudJqPOyZUNFLetiExzta2iyPGwKUtZ6H61vp0yBnEWB39fNzkBeruvg==',key_name='tempest-keypair-158567399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ef29871498426e9f410dcea7a3b947',ramdisk_id='',reservation_id='r-n2dd77ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1188834628',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1188834628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a90176398446d1ba20ecd6d45eb057',uuid=bb7d8ce2-141a-4ba9-b545-858875307ff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Converting VIF {"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:6b:02,bridge_name='br-int',has_traffic_filtering=True,id=91ba2e98-54ab-4357-b08d-edaf5bf4cfd6,network=Network(dfe0e2b6-32dd-4801-bca4-ddd8944e9474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ba2e98-54') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG os_vif [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:6b:02,bridge_name='br-int',has_traffic_filtering=True,id=91ba2e98-54ab-4357-b08d-edaf5bf4cfd6,network=Network(dfe0e2b6-32dd-4801-bca4-ddd8944e9474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ba2e98-54') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91ba2e98-54, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91ba2e98-54, col_values=(('external_ids', {'iface-id': '91ba2e98-54ab-4357-b08d-edaf5bf4cfd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:6b:02', 'vm-uuid': 'bb7d8ce2-141a-4ba9-b545-858875307ff0'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:40:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:47 user nova-compute[73052]: INFO os_vif [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:6b:02,bridge_name='br-int',has_traffic_filtering=True,id=91ba2e98-54ab-4357-b08d-edaf5bf4cfd6,network=Network(dfe0e2b6-32dd-4801-bca4-ddd8944e9474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ba2e98-54')
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] No VIF found with MAC fa:16:3e:22:6b:02, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060848.4245286, 55971d31-4c54-4150-bfbd-4636df306fbd => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] VM Resumed (Lifecycle Event)
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Instance spawned successfully.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.network.neutron [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Updated VIF entry in instance network info cache for port 91ba2e98-54ab-4357-b08d-edaf5bf4cfd6. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.network.neutron [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Updating instance_info_cache with network_info: [{"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba73df9b-7fbe-4d7b-8d74-0c5cd059bcf9 req-ece5ce3d-d5e8-49ce-a8fd-2c1c19bf2e3b service nova] Releasing lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060848.4247036, 55971d31-4c54-4150-bfbd-4636df306fbd => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] VM Started (Lifecycle Event)
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Instance spawned successfully.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060848.588535, fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] VM Resumed (Lifecycle Event)
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Took 11.93 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Instance spawned successfully.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060848.5921187, fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] VM Started (Lifecycle Event)
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Took 9.31 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060848.7054305, af3029db-dce7-4f4e-b907-630ac9ff72d0 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] VM Resumed (Lifecycle Event)
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Took 12.95 seconds to build instance.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8376843b-bb04-4735-b399-120c24db7576 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.114s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Took 15.95 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received event network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] No waiting events found dispatching network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:48 user nova-compute[73052]: WARNING nova.compute.manager [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received unexpected event network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa for instance with vm_state building and task_state spawning.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received event network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] No waiting events found dispatching network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:48 user nova-compute[73052]: WARNING nova.compute.manager [req-75f3815b-0bc0-41c5-86e0-33869f180511 req-54618d76-2b74-4359-96dc-5e5130c1daa9 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received unexpected event network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa for instance with vm_state building and task_state spawning.
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060848.706985, af3029db-dce7-4f4e-b907-630ac9ff72d0 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] VM Started (Lifecycle Event)
Aug 26 14:40:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:48 user nova-compute[73052]: INFO nova.compute.manager [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Took 10.75 seconds to build instance.
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:40:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ea13d9df-2563-4eaa-96e3-917ab10ca159 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.976s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:49 user nova-compute[73052]: INFO nova.compute.manager [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Took 17.10 seconds to build instance.
Aug 26 14:40:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Skipping network cache update for instance because it is Building. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9b906b0-3d49-4306-bb8c-221493d3933b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.435s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 79922a3f-53e3-4d29-8000-902e986e30c0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-7ef4b813-85e5-45f6-a23b-33598e9a7adc req-cc4fdc0e-83ac-4133-964a-117f77b49a5f service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received event network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ef4b813-85e5-45f6-a23b-33598e9a7adc req-cc4fdc0e-83ac-4133-964a-117f77b49a5f service nova] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ef4b813-85e5-45f6-a23b-33598e9a7adc req-cc4fdc0e-83ac-4133-964a-117f77b49a5f service nova] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ef4b813-85e5-45f6-a23b-33598e9a7adc req-cc4fdc0e-83ac-4133-964a-117f77b49a5f service nova] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-7ef4b813-85e5-45f6-a23b-33598e9a7adc req-cc4fdc0e-83ac-4133-964a-117f77b49a5f service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] No waiting events found dispatching network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:50 user nova-compute[73052]: WARNING nova.compute.manager [req-7ef4b813-85e5-45f6-a23b-33598e9a7adc req-cc4fdc0e-83ac-4133-964a-117f77b49a5f service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received unexpected event network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 for instance with vm_state building and task_state spawning.
Aug 26 14:40:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Updating instance_info_cache with network_info: [{"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-f3feeb86-c285-43a4-a36e-1a103c2baec6 req-b5d2ba3f-dc7e-427a-80d8-2c72da0b394a service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received event network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f3feeb86-c285-43a4-a36e-1a103c2baec6 req-b5d2ba3f-dc7e-427a-80d8-2c72da0b394a service nova] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f3feeb86-c285-43a4-a36e-1a103c2baec6 req-b5d2ba3f-dc7e-427a-80d8-2c72da0b394a service nova] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f3feeb86-c285-43a4-a36e-1a103c2baec6 req-b5d2ba3f-dc7e-427a-80d8-2c72da0b394a service nova] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-f3feeb86-c285-43a4-a36e-1a103c2baec6 req-b5d2ba3f-dc7e-427a-80d8-2c72da0b394a service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] No waiting events found dispatching network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:52 user nova-compute[73052]: WARNING nova.compute.manager [req-f3feeb86-c285-43a4-a36e-1a103c2baec6 req-b5d2ba3f-dc7e-427a-80d8-2c72da0b394a service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received unexpected event network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 for instance with vm_state building and task_state spawning.
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060852.6917527, bb7d8ce2-141a-4ba9-b545-858875307ff0 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:52 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] VM Resumed (Lifecycle Event)
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:40:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Instance spawned successfully.
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:40:52 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060852.6957695, bb7d8ce2-141a-4ba9-b545-858875307ff0 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:40:52 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] VM Started (Lifecycle Event)
Aug 26 14:40:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:40:52 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:40:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:52 user nova-compute[73052]: INFO nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Took 8.91 seconds to spawn the instance on the hypervisor.
Aug 26 14:40:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:40:53 user nova-compute[73052]: INFO nova.compute.manager [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Took 10.14 seconds to build instance.
Aug 26 14:40:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2abf9aef-734d-4f98-bd38-e08f4a88be36 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.262s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:40:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:53 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:40:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json" returned: 0 in 0.386s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-bfe9651b-e964-45fc-a44c-793fcbe40860 req-c87b1a2b-c9c5-4ecb-9fa1-aa55056a34e9 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received event network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bfe9651b-e964-45fc-a44c-793fcbe40860 req-c87b1a2b-c9c5-4ecb-9fa1-aa55056a34e9 service nova] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bfe9651b-e964-45fc-a44c-793fcbe40860 req-c87b1a2b-c9c5-4ecb-9fa1-aa55056a34e9 service nova] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bfe9651b-e964-45fc-a44c-793fcbe40860 req-c87b1a2b-c9c5-4ecb-9fa1-aa55056a34e9 service nova] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-bfe9651b-e964-45fc-a44c-793fcbe40860 req-c87b1a2b-c9c5-4ecb-9fa1-aa55056a34e9 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] No waiting events found dispatching network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:57 user nova-compute[73052]: WARNING nova.compute.manager [req-bfe9651b-e964-45fc-a44c-793fcbe40860 req-c87b1a2b-c9c5-4ecb-9fa1-aa55056a34e9 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received unexpected event network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 for instance with vm_state active and task_state None.
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:40:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:40:59 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:59 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7746MB free_disk=25.711029052734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-546592fb-a841-4c6f-b109-1df692d3d64d req-00f16641-3e2a-465b-b128-1f9d1a22da59 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received event network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-546592fb-a841-4c6f-b109-1df692d3d64d req-00f16641-3e2a-465b-b128-1f9d1a22da59 service nova] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-546592fb-a841-4c6f-b109-1df692d3d64d req-00f16641-3e2a-465b-b128-1f9d1a22da59 service nova] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-546592fb-a841-4c6f-b109-1df692d3d64d req-00f16641-3e2a-465b-b128-1f9d1a22da59 service nova] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-546592fb-a841-4c6f-b109-1df692d3d64d req-00f16641-3e2a-465b-b128-1f9d1a22da59 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] No waiting events found dispatching network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:40:59 user nova-compute[73052]: WARNING nova.compute.manager [req-546592fb-a841-4c6f-b109-1df692d3d64d req-00f16641-3e2a-465b-b128-1f9d1a22da59 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received unexpected event network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 for instance with vm_state active and task_state None.
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 79922a3f-53e3-4d29-8000-902e986e30c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance acb26430-b816-4969-b379-720e98cf59e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance af3029db-dce7-4f4e-b907-630ac9ff72d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 55971d31-4c54-4150-bfbd-4636df306fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance bb7d8ce2-141a-4ba9-b545-858875307ff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 14:40:59 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 14:41:00 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:41:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:41:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:41:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.541s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "335b65f2-0096-41fe-9ad2-71335afdd454" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "335b65f2-0096-41fe-9ad2-71335afdd454" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:41:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:26 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:41:26 user nova-compute[73052]: INFO nova.compute.claims [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Claim successful on node user
Aug 26 14:41:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:41:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:41:27 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:41:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG nova.policy [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d8522ef503248a9b04ea8b55564c506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30376a3f4f524f83b95f4e1f52383c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:41:27 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Creating image(s)
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "/opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "/opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "/opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.192s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk 1073741824" returned: 0 in 0.045s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:41:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Successfully created port: 4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Cannot resize image /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Ensure instance console log exists: /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Successfully updated port: 4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "refresh_cache-335b65f2-0096-41fe-9ad2-71335afdd454" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquired lock "refresh_cache-335b65f2-0096-41fe-9ad2-71335afdd454" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-7ecb1533-9bb7-4256-b599-1bd5e7469007 req-f074ec35-fa88-4356-813f-d3e872578ac7 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received event network-changed-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-7ecb1533-9bb7-4256-b599-1bd5e7469007 req-f074ec35-fa88-4356-813f-d3e872578ac7 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Refreshing instance network info cache due to event network-changed-4db1cf5d-33f0-488a-bf04-3cc2e9507294. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ecb1533-9bb7-4256-b599-1bd5e7469007 req-f074ec35-fa88-4356-813f-d3e872578ac7 service nova] Acquiring lock "refresh_cache-335b65f2-0096-41fe-9ad2-71335afdd454" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Updating instance_info_cache with network_info: [{"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Releasing lock "refresh_cache-335b65f2-0096-41fe-9ad2-71335afdd454" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Instance network_info: |[{"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ecb1533-9bb7-4256-b599-1bd5e7469007 req-f074ec35-fa88-4356-813f-d3e872578ac7 service nova] Acquired lock "refresh_cache-335b65f2-0096-41fe-9ad2-71335afdd454" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-7ecb1533-9bb7-4256-b599-1bd5e7469007 req-f074ec35-fa88-4356-813f-d3e872578ac7 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Refreshing network info cache for port 4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Start _get_guest_xml network_info=[{"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:41:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:41:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1956061972',display_name='tempest-VolumesActionsTest-instance-1956061972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1956061972',id=10,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30376a3f4f524f83b95f4e1f52383c3d',ramdisk_id='',reservation_id='r-4373fbf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1060392860',owner_user_name='tempest-VolumesActionsTest-1060392860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:41:27Z,user_data=None,user_id='6d8522ef503248a9b04ea8b55564c506',uuid=335b65f2-0096-41fe-9ad2-71335afdd454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Converting VIF {"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:22:1b,bridge_name='br-int',has_traffic_filtering=True,id=4db1cf5d-33f0-488a-bf04-3cc2e9507294,network=Network(14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db1cf5d-33') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lazy-loading 'pci_devices' on Instance uuid 335b65f2-0096-41fe-9ad2-71335afdd454 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:41:29 user nova-compute[73052]:   <uuid>335b65f2-0096-41fe-9ad2-71335afdd454</uuid>
Aug 26 14:41:29 user nova-compute[73052]:   <name>instance-0000000a</name>
Aug 26 14:41:29 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:41:29 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:41:29 user nova-compute[73052]:   <metadata>
Aug 26 14:41:29 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:41:29 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:41:29 user nova-compute[73052]:       <nova:name>tempest-VolumesActionsTest-instance-1956061972</nova:name>
Aug 26 14:41:29 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:41:29</nova:creationTime>
Aug 26 14:41:29 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:41:29 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:41:29 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:41:29 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:41:29 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:41:29 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:41:29 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:41:29 user nova-compute[73052]:       <nova:owner>
Aug 26 14:41:29 user nova-compute[73052]:         <nova:user uuid="6d8522ef503248a9b04ea8b55564c506">tempest-VolumesActionsTest-1060392860-project-member</nova:user>
Aug 26 14:41:29 user nova-compute[73052]:         <nova:project uuid="30376a3f4f524f83b95f4e1f52383c3d">tempest-VolumesActionsTest-1060392860</nova:project>
Aug 26 14:41:29 user nova-compute[73052]:       </nova:owner>
Aug 26 14:41:29 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:41:29 user nova-compute[73052]:       <nova:ports>
Aug 26 14:41:29 user nova-compute[73052]:         <nova:port uuid="4db1cf5d-33f0-488a-bf04-3cc2e9507294">
Aug 26 14:41:29 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:41:29 user nova-compute[73052]:         </nova:port>
Aug 26 14:41:29 user nova-compute[73052]:       </nova:ports>
Aug 26 14:41:29 user nova-compute[73052]:     </nova:instance>
Aug 26 14:41:29 user nova-compute[73052]:   </metadata>
Aug 26 14:41:29 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:41:29 user nova-compute[73052]:     <system>
Aug 26 14:41:29 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:41:29 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:41:29 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:41:29 user nova-compute[73052]:       <entry name="serial">335b65f2-0096-41fe-9ad2-71335afdd454</entry>
Aug 26 14:41:29 user nova-compute[73052]:       <entry name="uuid">335b65f2-0096-41fe-9ad2-71335afdd454</entry>
Aug 26 14:41:29 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:41:29 user nova-compute[73052]:     </system>
Aug 26 14:41:29 user nova-compute[73052]:   </sysinfo>
Aug 26 14:41:29 user nova-compute[73052]:   <os>
Aug 26 14:41:29 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:41:29 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:41:29 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:41:29 user nova-compute[73052]:   </os>
Aug 26 14:41:29 user nova-compute[73052]:   <features>
Aug 26 14:41:29 user nova-compute[73052]:     <acpi/>
Aug 26 14:41:29 user nova-compute[73052]:     <apic/>
Aug 26 14:41:29 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:41:29 user nova-compute[73052]:   </features>
Aug 26 14:41:29 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:41:29 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:41:29 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:41:29 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:41:29 user nova-compute[73052]:   </clock>
Aug 26 14:41:29 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:41:29 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:41:29 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:41:29 user nova-compute[73052]:   </cpu>
Aug 26 14:41:29 user nova-compute[73052]:   <devices>
Aug 26 14:41:29 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:41:29 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:41:29 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk"/>
Aug 26 14:41:29 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:41:29 user nova-compute[73052]:     </disk>
Aug 26 14:41:29 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:41:29 user nova-compute[73052]:       <mac address="fa:16:3e:e2:22:1b"/>
Aug 26 14:41:29 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:41:29 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:41:29 user nova-compute[73052]:       <target dev="tap4db1cf5d-33"/>
Aug 26 14:41:29 user nova-compute[73052]:     </interface>
Aug 26 14:41:29 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:41:29 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/console.log" append="off"/>
Aug 26 14:41:29 user nova-compute[73052]:     </serial>
Aug 26 14:41:29 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:41:29 user nova-compute[73052]:     <video>
Aug 26 14:41:29 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:41:29 user nova-compute[73052]:     </video>
Aug 26 14:41:29 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:41:29 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:41:29 user nova-compute[73052]:     </rng>
Aug 26 14:41:29 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:41:29 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:41:29 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:41:29 user nova-compute[73052]:     </memballoon>
Aug 26 14:41:29 user nova-compute[73052]:   </devices>
Aug 26 14:41:29 user nova-compute[73052]: </domain>
Aug 26 14:41:29 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1956061972',display_name='tempest-VolumesActionsTest-instance-1956061972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1956061972',id=10,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30376a3f4f524f83b95f4e1f52383c3d',ramdisk_id='',reservation_id='r-4373fbf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1060392860',owner_user_name='tempest-VolumesActionsTest-1060392860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:41:27Z,user_data=None,user_id='6d8522ef503248a9b04ea8b55564c506',uuid=335b65f2-0096-41fe-9ad2-71335afdd454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Converting VIF {"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:22:1b,bridge_name='br-int',has_traffic_filtering=True,id=4db1cf5d-33f0-488a-bf04-3cc2e9507294,network=Network(14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db1cf5d-33') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG os_vif [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:22:1b,bridge_name='br-int',has_traffic_filtering=True,id=4db1cf5d-33f0-488a-bf04-3cc2e9507294,network=Network(14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db1cf5d-33') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4db1cf5d-33, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4db1cf5d-33, col_values=(('external_ids', {'iface-id': '4db1cf5d-33f0-488a-bf04-3cc2e9507294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:22:1b', 'vm-uuid': '335b65f2-0096-41fe-9ad2-71335afdd454'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:29 user nova-compute[73052]: INFO os_vif [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:22:1b,bridge_name='br-int',has_traffic_filtering=True,id=4db1cf5d-33f0-488a-bf04-3cc2e9507294,network=Network(14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db1cf5d-33')
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] No VIF found with MAC fa:16:3e:e2:22:1b, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-7ecb1533-9bb7-4256-b599-1bd5e7469007 req-f074ec35-fa88-4356-813f-d3e872578ac7 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Updated VIF entry in instance network info cache for port 4db1cf5d-33f0-488a-bf04-3cc2e9507294. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-7ecb1533-9bb7-4256-b599-1bd5e7469007 req-f074ec35-fa88-4356-813f-d3e872578ac7 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Updating instance_info_cache with network_info: [{"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7ecb1533-9bb7-4256-b599-1bd5e7469007 req-f074ec35-fa88-4356-813f-d3e872578ac7 service nova] Releasing lock "refresh_cache-335b65f2-0096-41fe-9ad2-71335afdd454" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:41:30 user nova-compute[73052]: INFO nova.compute.claims [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Claim successful on node user
Aug 26 14:41:30 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:41:30 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:41:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:41:30 user nova-compute[73052]: INFO nova.virt.block_device [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Booting with volume c3ef495a-6902-45c5-a8b6-195f586cb84e at /dev/vda
Aug 26 14:41:30 user nova-compute[73052]: DEBUG nova.policy [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fe3f4a562b249adb11042d070008e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b4d9738fee4f0d8670371434d086e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG os_brick.utils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:41:30 user nova-compute[73052]: INFO oslo.privsep.daemon [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp_0uzwsye/privsep.sock']
Aug 26 14:41:30 user sudo[84262]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp_0uzwsye/privsep.sock
Aug 26 14:41:30 user sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 14:41:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-86260e10-395d-4366-afc9-184b9159a288 req-f08558b2-b50f-4f93-baf9-ae5f893cb73a service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received event network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-86260e10-395d-4366-afc9-184b9159a288 req-f08558b2-b50f-4f93-baf9-ae5f893cb73a service nova] Acquiring lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-86260e10-395d-4366-afc9-184b9159a288 req-f08558b2-b50f-4f93-baf9-ae5f893cb73a service nova] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-86260e10-395d-4366-afc9-184b9159a288 req-f08558b2-b50f-4f93-baf9-ae5f893cb73a service nova] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-86260e10-395d-4366-afc9-184b9159a288 req-f08558b2-b50f-4f93-baf9-ae5f893cb73a service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] No waiting events found dispatching network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:41:31 user nova-compute[73052]: WARNING nova.compute.manager [req-86260e10-395d-4366-afc9-184b9159a288 req-f08558b2-b50f-4f93-baf9-ae5f893cb73a service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received unexpected event network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 for instance with vm_state building and task_state spawning.
Aug 26 14:41:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Successfully created port: 37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:41:32 user sudo[84262]: pam_unix(sudo:session): session closed for user root
Aug 26 14:41:32 user nova-compute[73052]: INFO oslo.privsep.daemon [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Spawned new privsep daemon via rootwrap
Aug 26 14:41:32 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 14:41:32 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 14:41:32 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 14:41:32 user nova-compute[73052]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84351
Aug 26 14:41:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f56e06-59db-47e3-92b9-a8acb2bff654]: (2,) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Successfully updated port: 37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:41:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquired lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:41:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[28112702-89f4-4ca6-9871-219130674d16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:33 user nova-compute[73052]: WARNING os_brick.initiator.connectors.nvmeof [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08b4ca2-fe10-4a40-be85-f128804a9120]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[23315a65-f0d5-4534-901b-ffd553edf09f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4eec39-96c6-4e6b-8292-f4c2bfd01ffb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:41:33 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[28052773-0f4a-4d27-987c-beba5793f19e]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG os_brick.utils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] <== get_connector_properties: return (2284ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Updating existing volume attachment record: 699ec80a-9d48-4768-9835-bf6d0903f07b {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060893.1778688, 335b65f2-0096-41fe-9ad2-71335afdd454 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:41:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] VM Resumed (Lifecycle Event)
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:41:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Instance spawned successfully.
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:41:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060893.1786277, 335b65f2-0096-41fe-9ad2-71335afdd454 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:41:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] VM Started (Lifecycle Event)
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:41:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:41:33 user nova-compute[73052]: INFO nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received event network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] Acquiring lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] No waiting events found dispatching network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:41:33 user nova-compute[73052]: WARNING nova.compute.manager [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received unexpected event network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 for instance with vm_state building and task_state spawning.
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-changed-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Refreshing instance network info cache due to event network-changed-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] Acquiring lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Updating instance_info_cache with network_info: [{"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Releasing lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance network_info: |[{"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] Acquired lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.network.neutron [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Refreshing network info cache for port 37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:41:33 user nova-compute[73052]: INFO nova.compute.manager [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Took 6.85 seconds to build instance.
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-66eeb2e1-4776-4229-b898-287f119572a8 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "335b65f2-0096-41fe-9ad2-71335afdd454" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.941s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.network.neutron [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Updated VIF entry in instance network info cache for port 37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG nova.network.neutron [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Updating instance_info_cache with network_info: [{"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c4482876-d6e7-451d-a040-8684e8402590 req-467b5b90-8050-4bb7-b880-723567779bf0 service nova] Releasing lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:41:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:41:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:41:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:41:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:41:47 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Creating image(s)
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Ensure instance console log exists: /opt/stack/data/nova/instances/f0a01be4-94ff-4f2e-930f-a1e90b79abee/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Start _get_guest_xml network_info=[{"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '699ec80a-9d48-4768-9835-bf6d0903f07b', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0a01be4-94ff-4f2e-930f-a1e90b79abee', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3ef495a-6902-45c5-a8b6-195f586cb84e', 'serial': 'c3ef495a-6902-45c5-a8b6-195f586cb84e'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:41:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:41:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connector [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Factory for ISCSI on None {{(pid=73052) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:41:47 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:41:47 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:41:47 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fbc7e9-fe87-4005-84d2-6ed4f8144cac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:41:47 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1bd876-fd30-4eba-99f1-9c7988ae1b3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e] added
Aug 26 14:41:47 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[43db0b0c-7767-46c2-8d7d-e1e3167e0b7f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe65033-bf30-46cf-bff3-85010facac73]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPtdKJSQ {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPtdKJSQ" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92f25e2-b30e-4ccb-843f-e1b3031147f2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aPtdKJSQ'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c3392c-594e-40f3-8456-4037c66eada0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9562d46-705a-4702-bf1d-34a2ff178578]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:41:47 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:41:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:41:47 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:41:47 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 14:41:47 user nova-compute[73052]: 
Aug 26 14:41:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54f6ee8-3c8c-4029-a456-a14adf9d428e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260]
Aug 26 14:41:48 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260] successful.
Aug 26 14:41:48 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[61355c15-f8ee-40de-ac91-69e6018cf0bd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f017faff-2879-4a0b-afc7-c3cdc965353c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:41:48 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:41:48 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2583af58-ec0a-41db-9dab-191da24d9608]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:41:48 user nova-compute[73052]: INFO nova.compute.claims [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Claim successful on node user
Aug 26 14:41:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:48 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.network.neutron [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26637643561393931', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637643561393931', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:41:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1009623059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1009623059',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfBT9UGn/x6RhdSNVThc9709tWxKHd6uEPnsmjrMDl00UJ5WNxNYiqynxvWwjc21UlKvegnvwH1hbCsy0UqTdMc3LUYbgvkFLENhpgsRbhQCqJRHoVO3Cf5KM4QrR4hQ==',key_name='tempest-keypair-165596234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23b4d9738fee4f0d8670371434d086e7',ramdisk_id='',reservation_id='r-nd0jgg04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-122650918',owner_user_name='tempest-ServerActionsV293TestJSON-122650918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe3f4a562b249adb11042d070008e2c',uuid=f0a01be4-94ff-4f2e-930f-a1e90b79abee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converting VIF {"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.objects.instance [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lazy-loading 'pci_devices' on Instance uuid f0a01be4-94ff-4f2e-930f-a1e90b79abee {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:41:49 user nova-compute[73052]:   <uuid>f0a01be4-94ff-4f2e-930f-a1e90b79abee</uuid>
Aug 26 14:41:49 user nova-compute[73052]:   <name>instance-0000000b</name>
Aug 26 14:41:49 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:41:49 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:41:49 user nova-compute[73052]:   <metadata>
Aug 26 14:41:49 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:41:49 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:41:49 user nova-compute[73052]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1009623059</nova:name>
Aug 26 14:41:49 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:41:47</nova:creationTime>
Aug 26 14:41:49 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:41:49 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:41:49 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:41:49 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:41:49 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:41:49 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:41:49 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:41:49 user nova-compute[73052]:       <nova:owner>
Aug 26 14:41:49 user nova-compute[73052]:         <nova:user uuid="1fe3f4a562b249adb11042d070008e2c">tempest-ServerActionsV293TestJSON-122650918-project-member</nova:user>
Aug 26 14:41:49 user nova-compute[73052]:         <nova:project uuid="23b4d9738fee4f0d8670371434d086e7">tempest-ServerActionsV293TestJSON-122650918</nova:project>
Aug 26 14:41:49 user nova-compute[73052]:       </nova:owner>
Aug 26 14:41:49 user nova-compute[73052]:       <nova:ports>
Aug 26 14:41:49 user nova-compute[73052]:         <nova:port uuid="37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5">
Aug 26 14:41:49 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 14:41:49 user nova-compute[73052]:         </nova:port>
Aug 26 14:41:49 user nova-compute[73052]:       </nova:ports>
Aug 26 14:41:49 user nova-compute[73052]:     </nova:instance>
Aug 26 14:41:49 user nova-compute[73052]:   </metadata>
Aug 26 14:41:49 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:41:49 user nova-compute[73052]:     <system>
Aug 26 14:41:49 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:41:49 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:41:49 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:41:49 user nova-compute[73052]:       <entry name="serial">f0a01be4-94ff-4f2e-930f-a1e90b79abee</entry>
Aug 26 14:41:49 user nova-compute[73052]:       <entry name="uuid">f0a01be4-94ff-4f2e-930f-a1e90b79abee</entry>
Aug 26 14:41:49 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:41:49 user nova-compute[73052]:     </system>
Aug 26 14:41:49 user nova-compute[73052]:   </sysinfo>
Aug 26 14:41:49 user nova-compute[73052]:   <os>
Aug 26 14:41:49 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:41:49 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:41:49 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:41:49 user nova-compute[73052]:   </os>
Aug 26 14:41:49 user nova-compute[73052]:   <features>
Aug 26 14:41:49 user nova-compute[73052]:     <acpi/>
Aug 26 14:41:49 user nova-compute[73052]:     <apic/>
Aug 26 14:41:49 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:41:49 user nova-compute[73052]:   </features>
Aug 26 14:41:49 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:41:49 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:41:49 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:41:49 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:41:49 user nova-compute[73052]:   </clock>
Aug 26 14:41:49 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:41:49 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:41:49 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:41:49 user nova-compute[73052]:   </cpu>
Aug 26 14:41:49 user nova-compute[73052]:   <devices>
Aug 26 14:41:49 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:41:49 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:41:49 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 14:41:49 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:41:49 user nova-compute[73052]:       <serial>c3ef495a-6902-45c5-a8b6-195f586cb84e</serial>
Aug 26 14:41:49 user nova-compute[73052]:     </disk>
Aug 26 14:41:49 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:41:49 user nova-compute[73052]:       <mac address="fa:16:3e:c7:a2:46"/>
Aug 26 14:41:49 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:41:49 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:41:49 user nova-compute[73052]:       <target dev="tap37b4ca8a-8f"/>
Aug 26 14:41:49 user nova-compute[73052]:     </interface>
Aug 26 14:41:49 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:41:49 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/f0a01be4-94ff-4f2e-930f-a1e90b79abee/console.log" append="off"/>
Aug 26 14:41:49 user nova-compute[73052]:     </serial>
Aug 26 14:41:49 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:41:49 user nova-compute[73052]:     <video>
Aug 26 14:41:49 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:41:49 user nova-compute[73052]:     </video>
Aug 26 14:41:49 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:41:49 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:41:49 user nova-compute[73052]:     </rng>
Aug 26 14:41:49 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:41:49 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:41:49 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:41:49 user nova-compute[73052]:     </memballoon>
Aug 26 14:41:49 user nova-compute[73052]:   </devices>
Aug 26 14:41:49 user nova-compute[73052]: </domain>
Aug 26 14:41:49 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1009623059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1009623059',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfBT9UGn/x6RhdSNVThc9709tWxKHd6uEPnsmjrMDl00UJ5WNxNYiqynxvWwjc21UlKvegnvwH1hbCsy0UqTdMc3LUYbgvkFLENhpgsRbhQCqJRHoVO3Cf5KM4QrR4hQ==',key_name='tempest-keypair-165596234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23b4d9738fee4f0d8670371434d086e7',ramdisk_id='',reservation_id='r-nd0jgg04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-122650918',owner_user_name='tempest-ServerActionsV293TestJSON-122650918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe3f4a562b249adb11042d070008e2c',uuid=f0a01be4-94ff-4f2e-930f-a1e90b79abee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converting VIF {"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG os_vif [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37b4ca8a-8f, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37b4ca8a-8f, col_values=(('external_ids', {'iface-id': '37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:a2:46', 'vm-uuid': 'f0a01be4-94ff-4f2e-930f-a1e90b79abee'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:49 user nova-compute[73052]: INFO os_vif [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f')
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.policy [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '321c53c447cb491585e8eb540b0f4157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbaaf64cd44c06b2c1ef28d17c28cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] No VIF found with MAC fa:16:3e:c7:a2:46, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:41:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Creating image(s)
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "/opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "/opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "/opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk 1073741824" returned: 0 in 0.052s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.network.neutron [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Successfully created port: 90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Cannot resize image /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Ensure instance console log exists: /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Successfully updated port: 90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "refresh_cache-779434fd-eaf2-48c1-8a96-1fcb6532fb32" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquired lock "refresh_cache-779434fd-eaf2-48c1-8a96-1fcb6532fb32" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-3ac76cf6-c899-43ad-af7e-a6222c7c903f req-5d303959-92cd-49d2-85e0-47e68836a23f service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received event network-changed-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-3ac76cf6-c899-43ad-af7e-a6222c7c903f req-5d303959-92cd-49d2-85e0-47e68836a23f service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Refreshing instance network info cache due to event network-changed-90a8d3bc-0229-4a80-bb56-db69f34bc9ff. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3ac76cf6-c899-43ad-af7e-a6222c7c903f req-5d303959-92cd-49d2-85e0-47e68836a23f service nova] Acquiring lock "refresh_cache-779434fd-eaf2-48c1-8a96-1fcb6532fb32" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-134b6a4d-f6fe-464e-b996-69d4eb2e3392 req-4066a486-7936-4df4-94a3-8af4afc55cb7 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-134b6a4d-f6fe-464e-b996-69d4eb2e3392 req-4066a486-7936-4df4-94a3-8af4afc55cb7 service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-134b6a4d-f6fe-464e-b996-69d4eb2e3392 req-4066a486-7936-4df4-94a3-8af4afc55cb7 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-134b6a4d-f6fe-464e-b996-69d4eb2e3392 req-4066a486-7936-4df4-94a3-8af4afc55cb7 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-134b6a4d-f6fe-464e-b996-69d4eb2e3392 req-4066a486-7936-4df4-94a3-8af4afc55cb7 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] No waiting events found dispatching network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:41:50 user nova-compute[73052]: WARNING nova.compute.manager [req-134b6a4d-f6fe-464e-b996-69d4eb2e3392 req-4066a486-7936-4df4-94a3-8af4afc55cb7 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received unexpected event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 for instance with vm_state building and task_state spawning.
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Updating instance_info_cache with network_info: [{"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Releasing lock "refresh_cache-779434fd-eaf2-48c1-8a96-1fcb6532fb32" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Instance network_info: |[{"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3ac76cf6-c899-43ad-af7e-a6222c7c903f req-5d303959-92cd-49d2-85e0-47e68836a23f service nova] Acquired lock "refresh_cache-779434fd-eaf2-48c1-8a96-1fcb6532fb32" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.network.neutron [req-3ac76cf6-c899-43ad-af7e-a6222c7c903f req-5d303959-92cd-49d2-85e0-47e68836a23f service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Refreshing network info cache for port 90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Start _get_guest_xml network_info=[{"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:41:51 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:41:51 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1415822880',display_name='tempest-ServersNegativeTestJSON-server-1415822880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1415822880',id=12,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bbaaf64cd44c06b2c1ef28d17c28cb',ramdisk_id='',reservation_id='r-28naw8je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-618175231',owner_user_name='tempest-ServersNegativeTestJSON-618175231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:41:49Z,user_data=None,user_id='321c53c447cb491585e8eb540b0f4157',uuid=779434fd-eaf2-48c1-8a96-1fcb6532fb32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converting VIF {"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:2a,bridge_name='br-int',has_traffic_filtering=True,id=90a8d3bc-0229-4a80-bb56-db69f34bc9ff,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8d3bc-02') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.objects.instance [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lazy-loading 'pci_devices' on Instance uuid 779434fd-eaf2-48c1-8a96-1fcb6532fb32 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:41:51 user nova-compute[73052]:   <uuid>779434fd-eaf2-48c1-8a96-1fcb6532fb32</uuid>
Aug 26 14:41:51 user nova-compute[73052]:   <name>instance-0000000c</name>
Aug 26 14:41:51 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:41:51 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:41:51 user nova-compute[73052]:   <metadata>
Aug 26 14:41:51 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:41:51 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:41:51 user nova-compute[73052]:       <nova:name>tempest-ServersNegativeTestJSON-server-1415822880</nova:name>
Aug 26 14:41:51 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:41:51</nova:creationTime>
Aug 26 14:41:51 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:41:51 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:41:51 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:41:51 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:41:51 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:41:51 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:41:51 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:41:51 user nova-compute[73052]:       <nova:owner>
Aug 26 14:41:51 user nova-compute[73052]:         <nova:user uuid="321c53c447cb491585e8eb540b0f4157">tempest-ServersNegativeTestJSON-618175231-project-member</nova:user>
Aug 26 14:41:51 user nova-compute[73052]:         <nova:project uuid="d5bbaaf64cd44c06b2c1ef28d17c28cb">tempest-ServersNegativeTestJSON-618175231</nova:project>
Aug 26 14:41:51 user nova-compute[73052]:       </nova:owner>
Aug 26 14:41:51 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:41:51 user nova-compute[73052]:       <nova:ports>
Aug 26 14:41:51 user nova-compute[73052]:         <nova:port uuid="90a8d3bc-0229-4a80-bb56-db69f34bc9ff">
Aug 26 14:41:51 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 14:41:51 user nova-compute[73052]:         </nova:port>
Aug 26 14:41:51 user nova-compute[73052]:       </nova:ports>
Aug 26 14:41:51 user nova-compute[73052]:     </nova:instance>
Aug 26 14:41:51 user nova-compute[73052]:   </metadata>
Aug 26 14:41:51 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:41:51 user nova-compute[73052]:     <system>
Aug 26 14:41:51 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:41:51 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:41:51 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:41:51 user nova-compute[73052]:       <entry name="serial">779434fd-eaf2-48c1-8a96-1fcb6532fb32</entry>
Aug 26 14:41:51 user nova-compute[73052]:       <entry name="uuid">779434fd-eaf2-48c1-8a96-1fcb6532fb32</entry>
Aug 26 14:41:51 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:41:51 user nova-compute[73052]:     </system>
Aug 26 14:41:51 user nova-compute[73052]:   </sysinfo>
Aug 26 14:41:51 user nova-compute[73052]:   <os>
Aug 26 14:41:51 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:41:51 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:41:51 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:41:51 user nova-compute[73052]:   </os>
Aug 26 14:41:51 user nova-compute[73052]:   <features>
Aug 26 14:41:51 user nova-compute[73052]:     <acpi/>
Aug 26 14:41:51 user nova-compute[73052]:     <apic/>
Aug 26 14:41:51 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:41:51 user nova-compute[73052]:   </features>
Aug 26 14:41:51 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:41:51 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:41:51 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:41:51 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:41:51 user nova-compute[73052]:   </clock>
Aug 26 14:41:51 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:41:51 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:41:51 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:41:51 user nova-compute[73052]:   </cpu>
Aug 26 14:41:51 user nova-compute[73052]:   <devices>
Aug 26 14:41:51 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:41:51 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:41:51 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk"/>
Aug 26 14:41:51 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:41:51 user nova-compute[73052]:     </disk>
Aug 26 14:41:51 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:41:51 user nova-compute[73052]:       <mac address="fa:16:3e:61:48:2a"/>
Aug 26 14:41:51 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:41:51 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:41:51 user nova-compute[73052]:       <target dev="tap90a8d3bc-02"/>
Aug 26 14:41:51 user nova-compute[73052]:     </interface>
Aug 26 14:41:51 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:41:51 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/console.log" append="off"/>
Aug 26 14:41:51 user nova-compute[73052]:     </serial>
Aug 26 14:41:51 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:41:51 user nova-compute[73052]:     <video>
Aug 26 14:41:51 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:41:51 user nova-compute[73052]:     </video>
Aug 26 14:41:51 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:41:51 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:41:51 user nova-compute[73052]:     </rng>
Aug 26 14:41:51 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:41:51 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:41:51 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:41:51 user nova-compute[73052]:     </memballoon>
Aug 26 14:41:51 user nova-compute[73052]:   </devices>
Aug 26 14:41:51 user nova-compute[73052]: </domain>
Aug 26 14:41:51 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1415822880',display_name='tempest-ServersNegativeTestJSON-server-1415822880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1415822880',id=12,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bbaaf64cd44c06b2c1ef28d17c28cb',ramdisk_id='',reservation_id='r-28naw8je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-618175231',owner_user_name='tempest-ServersNegativeTestJSON-618175231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:41:49Z,user_data=None,user_id='321c53c447cb491585e8eb540b0f4157',uuid=779434fd-eaf2-48c1-8a96-1fcb6532fb32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converting VIF {"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:2a,bridge_name='br-int',has_traffic_filtering=True,id=90a8d3bc-0229-4a80-bb56-db69f34bc9ff,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8d3bc-02') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG os_vif [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:2a,bridge_name='br-int',has_traffic_filtering=True,id=90a8d3bc-0229-4a80-bb56-db69f34bc9ff,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8d3bc-02') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90a8d3bc-02, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90a8d3bc-02, col_values=(('external_ids', {'iface-id': '90a8d3bc-0229-4a80-bb56-db69f34bc9ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:48:2a', 'vm-uuid': '779434fd-eaf2-48c1-8a96-1fcb6532fb32'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:51 user nova-compute[73052]: INFO os_vif [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:2a,bridge_name='br-int',has_traffic_filtering=True,id=90a8d3bc-0229-4a80-bb56-db69f34bc9ff,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8d3bc-02')
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] No VIF found with MAC fa:16:3e:61:48:2a, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.network.neutron [req-3ac76cf6-c899-43ad-af7e-a6222c7c903f req-5d303959-92cd-49d2-85e0-47e68836a23f service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Updated VIF entry in instance network info cache for port 90a8d3bc-0229-4a80-bb56-db69f34bc9ff. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG nova.network.neutron [req-3ac76cf6-c899-43ad-af7e-a6222c7c903f req-5d303959-92cd-49d2-85e0-47e68836a23f service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Updating instance_info_cache with network_info: [{"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3ac76cf6-c899-43ad-af7e-a6222c7c903f req-5d303959-92cd-49d2-85e0-47e68836a23f service nova] Releasing lock "refresh_cache-779434fd-eaf2-48c1-8a96-1fcb6532fb32" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060912.714396, f0a01be4-94ff-4f2e-930f-a1e90b79abee => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:41:52 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] VM Resumed (Lifecycle Event)
Aug 26 14:41:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance spawned successfully.
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:52 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060912.7152135, f0a01be4-94ff-4f2e-930f-a1e90b79abee => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:41:52 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] VM Started (Lifecycle Event)
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:41:52 user nova-compute[73052]: INFO nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:52 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-ddbd7d25-b4e5-4699-9f89-26827a62e92d req-85f9c020-88fa-4dda-b708-a7ff55f62027 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ddbd7d25-b4e5-4699-9f89-26827a62e92d req-85f9c020-88fa-4dda-b708-a7ff55f62027 service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ddbd7d25-b4e5-4699-9f89-26827a62e92d req-85f9c020-88fa-4dda-b708-a7ff55f62027 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ddbd7d25-b4e5-4699-9f89-26827a62e92d req-85f9c020-88fa-4dda-b708-a7ff55f62027 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-ddbd7d25-b4e5-4699-9f89-26827a62e92d req-85f9c020-88fa-4dda-b708-a7ff55f62027 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] No waiting events found dispatching network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:41:52 user nova-compute[73052]: WARNING nova.compute.manager [req-ddbd7d25-b4e5-4699-9f89-26827a62e92d req-85f9c020-88fa-4dda-b708-a7ff55f62027 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received unexpected event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 for instance with vm_state building and task_state spawning.
Aug 26 14:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:52 user nova-compute[73052]: INFO nova.compute.manager [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Took 22.95 seconds to build instance.
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-050aa365-7870-4941-8636-cda19f52e24e req-f2ec1837-943c-478d-a28d-d659aa0e64b5 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received event network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-050aa365-7870-4941-8636-cda19f52e24e req-f2ec1837-943c-478d-a28d-d659aa0e64b5 service nova] Acquiring lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-050aa365-7870-4941-8636-cda19f52e24e req-f2ec1837-943c-478d-a28d-d659aa0e64b5 service nova] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-050aa365-7870-4941-8636-cda19f52e24e req-f2ec1837-943c-478d-a28d-d659aa0e64b5 service nova] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-050aa365-7870-4941-8636-cda19f52e24e req-f2ec1837-943c-478d-a28d-d659aa0e64b5 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] No waiting events found dispatching network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:41:52 user nova-compute[73052]: WARNING nova.compute.manager [req-050aa365-7870-4941-8636-cda19f52e24e req-f2ec1837-943c-478d-a28d-d659aa0e64b5 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received unexpected event network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff for instance with vm_state building and task_state spawning.
Aug 26 14:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5edfdc44-2ccc-442c-bb51-ac2657f33837 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.049s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060914.8481643, 779434fd-eaf2-48c1-8a96-1fcb6532fb32 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:41:54 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] VM Resumed (Lifecycle Event)
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:41:54 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Instance spawned successfully.
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:41:54 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060914.849681, 779434fd-eaf2-48c1-8a96-1fcb6532fb32 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:41:54 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] VM Started (Lifecycle Event)
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:41:54 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:41:54 user nova-compute[73052]: INFO nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-be77292a-1f8d-4de6-8f53-99154fb99b3a req-da2b8aeb-3e45-471d-a804-202f9b0dc212 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received event network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-be77292a-1f8d-4de6-8f53-99154fb99b3a req-da2b8aeb-3e45-471d-a804-202f9b0dc212 service nova] Acquiring lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-be77292a-1f8d-4de6-8f53-99154fb99b3a req-da2b8aeb-3e45-471d-a804-202f9b0dc212 service nova] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-be77292a-1f8d-4de6-8f53-99154fb99b3a req-da2b8aeb-3e45-471d-a804-202f9b0dc212 service nova] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-be77292a-1f8d-4de6-8f53-99154fb99b3a req-da2b8aeb-3e45-471d-a804-202f9b0dc212 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] No waiting events found dispatching network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:41:54 user nova-compute[73052]: WARNING nova.compute.manager [req-be77292a-1f8d-4de6-8f53-99154fb99b3a req-da2b8aeb-3e45-471d-a804-202f9b0dc212 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received unexpected event network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff for instance with vm_state building and task_state spawning.
Aug 26 14:41:55 user nova-compute[73052]: INFO nova.compute.manager [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Took 6.62 seconds to build instance.
Aug 26 14:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-651c2411-f112-4478-9a31-77834dcafb27 tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.741s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:41:55 user nova-compute[73052]: INFO nova.compute.manager [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Rescuing
Aug 26 14:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquired lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:55 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updating instance_info_cache with network_info: [{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Releasing lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-567dc0d5-4c15-42e3-94d8-53bbfde7b457 req-67ee306e-38e2-4fd3-9740-faf75aba7615 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received event network-vif-unplugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-567dc0d5-4c15-42e3-94d8-53bbfde7b457 req-67ee306e-38e2-4fd3-9740-faf75aba7615 service nova] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-567dc0d5-4c15-42e3-94d8-53bbfde7b457 req-67ee306e-38e2-4fd3-9740-faf75aba7615 service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-567dc0d5-4c15-42e3-94d8-53bbfde7b457 req-67ee306e-38e2-4fd3-9740-faf75aba7615 service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-567dc0d5-4c15-42e3-94d8-53bbfde7b457 req-67ee306e-38e2-4fd3-9740-faf75aba7615 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] No waiting events found dispatching network-vif-unplugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:41:57 user nova-compute[73052]: WARNING nova.compute.manager [req-567dc0d5-4c15-42e3-94d8-53bbfde7b457 req-67ee306e-38e2-4fd3-9740-faf75aba7615 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received unexpected event network-vif-unplugged-b3728317-0c63-410c-bdb3-60166f01310d for instance with vm_state active and task_state rescuing.
Aug 26 14:41:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Instance destroyed successfully.
Aug 26 14:41:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Attempting rescue
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73052) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Instance directory exists: not creating {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 14:41:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Creating image(s)
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'trusted_certs' on Instance uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.225s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue" returned: 0 in 0.078s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'migration_context' on Instance uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<eb6033f4-da59-4900-a67f-1e244631f046> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Start _get_guest_xml network_info=[{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:3e:05:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'resources' on Instance uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<eb6033f4-da59-4900-a67f-1e244631f046> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'numa_topology' on Instance uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<eb6033f4-da59-4900-a67f-1e244631f046> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:41:58 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:41:58 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.objects.base [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<eb6033f4-da59-4900-a67f-1e244631f046> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-245647396',display_name='tempest-ServerRescueNegativeTestJSON-server-245647396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-245647396',id=3,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-skvo5tlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:21Z,user_data=None,user_id='966347969be04bb9a69cbdc441a94d8f',uuid=eb6033f4-da59-4900-a67f-1e244631f046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:3e:05:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:3e:05:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=b3728317-0c63-410c-bdb3-60166f01310d,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3728317-0c') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'pci_devices' on Instance uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.objects.base [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<eb6033f4-da59-4900-a67f-1e244631f046> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:41:58 user nova-compute[73052]:   <uuid>eb6033f4-da59-4900-a67f-1e244631f046</uuid>
Aug 26 14:41:58 user nova-compute[73052]:   <name>instance-00000003</name>
Aug 26 14:41:58 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:41:58 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:41:58 user nova-compute[73052]:   <metadata>
Aug 26 14:41:58 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:41:58 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:41:58 user nova-compute[73052]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-245647396</nova:name>
Aug 26 14:41:58 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:41:58</nova:creationTime>
Aug 26 14:41:58 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:41:58 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:41:58 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:41:58 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:41:58 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:41:58 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:41:58 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:41:58 user nova-compute[73052]:       <nova:owner>
Aug 26 14:41:58 user nova-compute[73052]:         <nova:user uuid="966347969be04bb9a69cbdc441a94d8f">tempest-ServerRescueNegativeTestJSON-2104819576-project-member</nova:user>
Aug 26 14:41:58 user nova-compute[73052]:         <nova:project uuid="6426cc5de72e40e4ba4570304328a568">tempest-ServerRescueNegativeTestJSON-2104819576</nova:project>
Aug 26 14:41:58 user nova-compute[73052]:       </nova:owner>
Aug 26 14:41:58 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:41:58 user nova-compute[73052]:       <nova:ports>
Aug 26 14:41:58 user nova-compute[73052]:         <nova:port uuid="b3728317-0c63-410c-bdb3-60166f01310d">
Aug 26 14:41:58 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 14:41:58 user nova-compute[73052]:         </nova:port>
Aug 26 14:41:58 user nova-compute[73052]:       </nova:ports>
Aug 26 14:41:58 user nova-compute[73052]:     </nova:instance>
Aug 26 14:41:58 user nova-compute[73052]:   </metadata>
Aug 26 14:41:58 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:41:58 user nova-compute[73052]:     <system>
Aug 26 14:41:58 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:41:58 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:41:58 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:41:58 user nova-compute[73052]:       <entry name="serial">eb6033f4-da59-4900-a67f-1e244631f046</entry>
Aug 26 14:41:58 user nova-compute[73052]:       <entry name="uuid">eb6033f4-da59-4900-a67f-1e244631f046</entry>
Aug 26 14:41:58 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:41:58 user nova-compute[73052]:     </system>
Aug 26 14:41:58 user nova-compute[73052]:   </sysinfo>
Aug 26 14:41:58 user nova-compute[73052]:   <os>
Aug 26 14:41:58 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:41:58 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:41:58 user nova-compute[73052]:   </os>
Aug 26 14:41:58 user nova-compute[73052]:   <features>
Aug 26 14:41:58 user nova-compute[73052]:     <acpi/>
Aug 26 14:41:58 user nova-compute[73052]:     <apic/>
Aug 26 14:41:58 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:41:58 user nova-compute[73052]:   </features>
Aug 26 14:41:58 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:41:58 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:41:58 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:41:58 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:41:58 user nova-compute[73052]:   </clock>
Aug 26 14:41:58 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:41:58 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:41:58 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:41:58 user nova-compute[73052]:   </cpu>
Aug 26 14:41:58 user nova-compute[73052]:   <devices>
Aug 26 14:41:58 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:41:58 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:41:58 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue"/>
Aug 26 14:41:58 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:41:58 user nova-compute[73052]:     </disk>
Aug 26 14:41:58 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:41:58 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:41:58 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk"/>
Aug 26 14:41:58 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:41:58 user nova-compute[73052]:     </disk>
Aug 26 14:41:58 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:41:58 user nova-compute[73052]:       <mac address="fa:16:3e:3e:05:1e"/>
Aug 26 14:41:58 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:41:58 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:41:58 user nova-compute[73052]:       <target dev="tapb3728317-0c"/>
Aug 26 14:41:58 user nova-compute[73052]:     </interface>
Aug 26 14:41:58 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:41:58 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/console.log" append="off"/>
Aug 26 14:41:58 user nova-compute[73052]:     </serial>
Aug 26 14:41:58 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:41:58 user nova-compute[73052]:     <video>
Aug 26 14:41:58 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:41:58 user nova-compute[73052]:     </video>
Aug 26 14:41:58 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:41:58 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:41:58 user nova-compute[73052]:     </rng>
Aug 26 14:41:58 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:41:58 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:41:58 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:41:58 user nova-compute[73052]:     </memballoon>
Aug 26 14:41:58 user nova-compute[73052]:   </devices>
Aug 26 14:41:58 user nova-compute[73052]: </domain>
Aug 26 14:41:58 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-38f1db13-2c9e-4c05-aa67-39c1b58d9860 req-25c39c30-1d96-4256-a990-c51365d09f5a service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-changed-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-38f1db13-2c9e-4c05-aa67-39c1b58d9860 req-25c39c30-1d96-4256-a990-c51365d09f5a service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Refreshing instance network info cache due to event network-changed-f87904f2-9bd7-46dd-a11b-4d870fbec13c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38f1db13-2c9e-4c05-aa67-39c1b58d9860 req-25c39c30-1d96-4256-a990-c51365d09f5a service nova] Acquiring lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38f1db13-2c9e-4c05-aa67-39c1b58d9860 req-25c39c30-1d96-4256-a990-c51365d09f5a service nova] Acquired lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-38f1db13-2c9e-4c05-aa67-39c1b58d9860 req-25c39c30-1d96-4256-a990-c51365d09f5a service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Refreshing network info cache for port f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:41:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Instance destroyed successfully.
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No VIF found with MAC fa:16:3e:3e:05:1e, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-38f1db13-2c9e-4c05-aa67-39c1b58d9860 req-25c39c30-1d96-4256-a990-c51365d09f5a service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updated VIF entry in instance network info cache for port f87904f2-9bd7-46dd-a11b-4d870fbec13c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-38f1db13-2c9e-4c05-aa67-39c1b58d9860 req-25c39c30-1d96-4256-a990-c51365d09f5a service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating instance_info_cache with network_info: [{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38f1db13-2c9e-4c05-aa67-39c1b58d9860 req-25c39c30-1d96-4256-a990-c51365d09f5a service nova] Releasing lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-1a431daa-f40b-4d19-8830-7174816f81f8 req-7fe75b25-b49d-4fab-91c7-9a1d5e46da3a service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1a431daa-f40b-4d19-8830-7174816f81f8 req-7fe75b25-b49d-4fab-91c7-9a1d5e46da3a service nova] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1a431daa-f40b-4d19-8830-7174816f81f8 req-7fe75b25-b49d-4fab-91c7-9a1d5e46da3a service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1a431daa-f40b-4d19-8830-7174816f81f8 req-7fe75b25-b49d-4fab-91c7-9a1d5e46da3a service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-1a431daa-f40b-4d19-8830-7174816f81f8 req-7fe75b25-b49d-4fab-91c7-9a1d5e46da3a service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] No waiting events found dispatching network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:41:59 user nova-compute[73052]: WARNING nova.compute.manager [req-1a431daa-f40b-4d19-8830-7174816f81f8 req-7fe75b25-b49d-4fab-91c7-9a1d5e46da3a service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received unexpected event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d for instance with vm_state active and task_state rescuing.
Aug 26 14:41:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:41:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] No waiting events found dispatching network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:01 user nova-compute[73052]: WARNING nova.compute.manager [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received unexpected event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d for instance with vm_state active and task_state rescuing.
Aug 26 14:42:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] No waiting events found dispatching network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:01 user nova-compute[73052]: WARNING nova.compute.manager [req-fac15f90-acd6-4ff8-8fd8-9ed8a56ee2b9 req-02485eb2-ebfa-41b6-b4eb-030e39180bc3 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received unexpected event network-vif-plugged-b3728317-0c63-410c-bdb3-60166f01310d for instance with vm_state active and task_state rescuing.
Aug 26 14:42:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for eb6033f4-da59-4900-a67f-1e244631f046 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060922.1457102, eb6033f4-da59-4900-a67f-1e244631f046 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:42:02 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] VM Resumed (Lifecycle Event)
Aug 26 14:42:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d5210ac3-ac00-497f-b5fe-30f55d68c220 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:02 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 14:42:02 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693060922.1519303, eb6033f4-da59-4900-a67f-1e244631f046 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:42:02 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] VM Started (Lifecycle Event)
Aug 26 14:42:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:05 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:42:05 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=6945MB free_disk=25.556659698486328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:05 user nova-compute[73052]: INFO nova.compute.manager [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Shelving
Aug 26 14:42:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 79922a3f-53e3-4d29-8000-902e986e30c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance acb26430-b816-4969-b379-720e98cf59e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance af3029db-dce7-4f4e-b907-630ac9ff72d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 55971d31-4c54-4150-bfbd-4636df306fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance bb7d8ce2-141a-4ba9-b545-858875307ff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 335b65f2-0096-41fe-9ad2-71335afdd454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f0a01be4-94ff-4f2e-930f-a1e90b79abee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 779434fd-eaf2-48c1-8a96-1fcb6532fb32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-b47b0abb-df55-4750-8624-027a78de4ff5 req-7adbf8f2-e698-40a2-8c04-be7e4c0a133a service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-unplugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b47b0abb-df55-4750-8624-027a78de4ff5 req-7adbf8f2-e698-40a2-8c04-be7e4c0a133a service nova] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b47b0abb-df55-4750-8624-027a78de4ff5 req-7adbf8f2-e698-40a2-8c04-be7e4c0a133a service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b47b0abb-df55-4750-8624-027a78de4ff5 req-7adbf8f2-e698-40a2-8c04-be7e4c0a133a service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-b47b0abb-df55-4750-8624-027a78de4ff5 req-7adbf8f2-e698-40a2-8c04-be7e4c0a133a service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] No waiting events found dispatching network-vif-unplugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:05 user nova-compute[73052]: WARNING nova.compute.manager [req-b47b0abb-df55-4750-8624-027a78de4ff5 req-7adbf8f2-e698-40a2-8c04-be7e4c0a133a service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received unexpected event network-vif-unplugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c for instance with vm_state active and task_state shelving.
Aug 26 14:42:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:06 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:42:06 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:42:06 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance destroyed successfully.
Aug 26 14:42:06 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:42:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.013s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:06 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Beginning cold snapshot process
Aug 26 14:42:06 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:42:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk /opt/stack/data/nova/instances/snapshots/tmp6oo5fzbs/d992a8bb1fc947d79331456919b30a63 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-a0334659-ed88-4e4a-9aef-6b8f827f85e4 req-339bd9bd-fa82-4050-8d87-198358363a1b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a0334659-ed88-4e4a-9aef-6b8f827f85e4 req-339bd9bd-fa82-4050-8d87-198358363a1b service nova] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a0334659-ed88-4e4a-9aef-6b8f827f85e4 req-339bd9bd-fa82-4050-8d87-198358363a1b service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a0334659-ed88-4e4a-9aef-6b8f827f85e4 req-339bd9bd-fa82-4050-8d87-198358363a1b service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-a0334659-ed88-4e4a-9aef-6b8f827f85e4 req-339bd9bd-fa82-4050-8d87-198358363a1b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] No waiting events found dispatching network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:08 user nova-compute[73052]: WARNING nova.compute.manager [req-a0334659-ed88-4e4a-9aef-6b8f827f85e4 req-339bd9bd-fa82-4050-8d87-198358363a1b service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received unexpected event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 26 14:42:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk /opt/stack/data/nova/instances/snapshots/tmp6oo5fzbs/d992a8bb1fc947d79331456919b30a63" returned: 0 in 1.777s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:08 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Snapshot extracted, beginning image upload
Aug 26 14:42:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Snapshot image upload complete
Aug 26 14:42:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:42:12 user nova-compute[73052]: INFO nova.compute.manager [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Shelve offloading
Aug 26 14:42:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance destroyed successfully.
Aug 26 14:42:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:42:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquired lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:12 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:42:12 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating instance_info_cache with network_info: [{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Releasing lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance destroyed successfully.
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'resources' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-488685255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-488685255',id=4,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3cf/nvxU1Q29x5etLTVRN/RQ0wT00lkZrqCUh0RYM7B4g67X/Lm72+DTghGliuZNzJ1HowMsSVP1RrPf2CC7oVhh1MBM7ZbVELfw80KWM8UIMDpmP/zDX6Kpg0pvIixg==',key_name='tempest-keypair-856206061',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-qy7djzrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member',shelved_at='2023-08-26T14:42:12.199134',shelved_host='user',shelved_image_id='999f4e48-450c-4184-ba8d-71a1c7e4c907'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=2e4f1fd3-d09f-4f6e-abda-9db2158eb46c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG os_vif [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf87904f2-9b, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:42:13 user nova-compute[73052]: INFO os_vif [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b')
Aug 26 14:42:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Deleting instance files /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c_del
Aug 26 14:42:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Deletion of /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c_del complete
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-b4ec75ad-cd34-46e0-8ff7-5628d0dd737f req-7d833c5b-015c-438d-ae3b-25ef237087f8 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-changed-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-b4ec75ad-cd34-46e0-8ff7-5628d0dd737f req-7d833c5b-015c-438d-ae3b-25ef237087f8 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Refreshing instance network info cache due to event network-changed-f87904f2-9bd7-46dd-a11b-4d870fbec13c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b4ec75ad-cd34-46e0-8ff7-5628d0dd737f req-7d833c5b-015c-438d-ae3b-25ef237087f8 service nova] Acquiring lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b4ec75ad-cd34-46e0-8ff7-5628d0dd737f req-7d833c5b-015c-438d-ae3b-25ef237087f8 service nova] Acquired lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.network.neutron [req-b4ec75ad-cd34-46e0-8ff7-5628d0dd737f req-7d833c5b-015c-438d-ae3b-25ef237087f8 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Refreshing network info cache for port f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73052) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 14:42:13 user nova-compute[73052]: INFO nova.virt.libvirt.host [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] UEFI support detected
Aug 26 14:42:13 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Deleted allocations for instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c
Aug 26 14:42:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:13 user nova-compute[73052]: DEBUG nova.objects.base [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<2e4f1fd3-d09f-4f6e-abda-9db2158eb46c> lazy-loaded attributes: resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:42:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:14 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:42:14 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:42:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f911d9fc-972f-4b60-b4ae-e79bc68538c8 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.033s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:14 user nova-compute[73052]: DEBUG nova.network.neutron [req-b4ec75ad-cd34-46e0-8ff7-5628d0dd737f req-7d833c5b-015c-438d-ae3b-25ef237087f8 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updated VIF entry in instance network info cache for port f87904f2-9bd7-46dd-a11b-4d870fbec13c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:42:14 user nova-compute[73052]: DEBUG nova.network.neutron [req-b4ec75ad-cd34-46e0-8ff7-5628d0dd737f req-7d833c5b-015c-438d-ae3b-25ef237087f8 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating instance_info_cache with network_info: [{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf87904f2-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b4ec75ad-cd34-46e0-8ff7-5628d0dd737f req-7d833c5b-015c-438d-ae3b-25ef237087f8 service nova] Releasing lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:21 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693060926.329962, 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:42:21 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] VM Stopped (Lifecycle Event)
Aug 26 14:42:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-df4bc58b-f4be-4ad7-935b-a024f082c74e None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:42:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-482f0f0f-9f77-40a3-8f91-cd0ac429b65f req-c74a0fae-7cc4-4bb5-a989-d4b6728edd72 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received event network-changed-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-482f0f0f-9f77-40a3-8f91-cd0ac429b65f req-c74a0fae-7cc4-4bb5-a989-d4b6728edd72 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Refreshing instance network info cache due to event network-changed-12ae594b-302d-483b-8832-eb05dae17537. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:42:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-482f0f0f-9f77-40a3-8f91-cd0ac429b65f req-c74a0fae-7cc4-4bb5-a989-d4b6728edd72 service nova] Acquiring lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-482f0f0f-9f77-40a3-8f91-cd0ac429b65f req-c74a0fae-7cc4-4bb5-a989-d4b6728edd72 service nova] Acquired lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-482f0f0f-9f77-40a3-8f91-cd0ac429b65f req-c74a0fae-7cc4-4bb5-a989-d4b6728edd72 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Refreshing network info cache for port 12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:42:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-482f0f0f-9f77-40a3-8f91-cd0ac429b65f req-c74a0fae-7cc4-4bb5-a989-d4b6728edd72 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updated VIF entry in instance network info cache for port 12ae594b-302d-483b-8832-eb05dae17537. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:42:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-482f0f0f-9f77-40a3-8f91-cd0ac429b65f req-c74a0fae-7cc4-4bb5-a989-d4b6728edd72 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updating instance_info_cache with network_info: [{"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-482f0f0f-9f77-40a3-8f91-cd0ac429b65f req-c74a0fae-7cc4-4bb5-a989-d4b6728edd72 service nova] Releasing lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-91237cc5-7be5-4e2f-afe9-e354db914940 req-16188516-4539-4762-b1c9-12f8329590ab service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received event network-changed-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-91237cc5-7be5-4e2f-afe9-e354db914940 req-16188516-4539-4762-b1c9-12f8329590ab service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Refreshing instance network info cache due to event network-changed-16c5ce06-c50f-443d-9bb8-884fe5e5c929. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-91237cc5-7be5-4e2f-afe9-e354db914940 req-16188516-4539-4762-b1c9-12f8329590ab service nova] Acquiring lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-91237cc5-7be5-4e2f-afe9-e354db914940 req-16188516-4539-4762-b1c9-12f8329590ab service nova] Acquired lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG nova.network.neutron [req-91237cc5-7be5-4e2f-afe9-e354db914940 req-16188516-4539-4762-b1c9-12f8329590ab service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Refreshing network info cache for port 16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG nova.network.neutron [req-91237cc5-7be5-4e2f-afe9-e354db914940 req-16188516-4539-4762-b1c9-12f8329590ab service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Updated VIF entry in instance network info cache for port 16c5ce06-c50f-443d-9bb8-884fe5e5c929. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG nova.network.neutron [req-91237cc5-7be5-4e2f-afe9-e354db914940 req-16188516-4539-4762-b1c9-12f8329590ab service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Updating instance_info_cache with network_info: [{"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-91237cc5-7be5-4e2f-afe9-e354db914940 req-16188516-4539-4762-b1c9-12f8329590ab service nova] Releasing lock "refresh_cache-af3029db-dce7-4f4e-b907-630ac9ff72d0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-e5e048f7-73ac-493e-9a41-a34c1eea7cdf req-7d885a4b-334e-4949-9e35-b6a753711197 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-changed-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-e5e048f7-73ac-493e-9a41-a34c1eea7cdf req-7d885a4b-334e-4949-9e35-b6a753711197 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Refreshing instance network info cache due to event network-changed-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e5e048f7-73ac-493e-9a41-a34c1eea7cdf req-7d885a4b-334e-4949-9e35-b6a753711197 service nova] Acquiring lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e5e048f7-73ac-493e-9a41-a34c1eea7cdf req-7d885a4b-334e-4949-9e35-b6a753711197 service nova] Acquired lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG nova.network.neutron [req-e5e048f7-73ac-493e-9a41-a34c1eea7cdf req-7d885a4b-334e-4949-9e35-b6a753711197 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Refreshing network info cache for port 64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lazy-loading 'flavor' on Instance uuid acb26430-b816-4969-b379-720e98cf59e6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:26 user nova-compute[73052]: INFO nova.compute.manager [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Attaching volume b282f9f9-e1b2-44f6-a362-7c6086af5834 to /dev/vdb
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "interface-55971d31-4c54-4150-bfbd-4636df306fbd-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "interface-55971d31-4c54-4150-bfbd-4636df306fbd-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG nova.objects.instance [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lazy-loading 'flavor' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG os_brick.utils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c7fa6d-75cd-42a2-b155-e3a2ac2140aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[083e75f8-3573-40df-836c-650ae5085ff4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b108fa-82b7-4e5d-ae2d-43a0f15820fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb53123d-7917-4cf4-9117-76c19a604039]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:27 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8531ad2-4074-4c6e-9de6-414f40e9ab4f]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG os_brick.utils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updating existing volume attachment record: a8c5018a-80d2-42a6-8486-f102515be70a {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG nova.network.neutron [req-e5e048f7-73ac-493e-9a41-a34c1eea7cdf req-7d885a4b-334e-4949-9e35-b6a753711197 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updated VIF entry in instance network info cache for port 64d1aab0-95f3-4ac4-bb41-cc97c1d5365e. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG nova.network.neutron [req-e5e048f7-73ac-493e-9a41-a34c1eea7cdf req-7d885a4b-334e-4949-9e35-b6a753711197 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating instance_info_cache with network_info: [{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e5e048f7-73ac-493e-9a41-a34c1eea7cdf req-7d885a4b-334e-4949-9e35-b6a753711197 service nova] Releasing lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG nova.objects.instance [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lazy-loading 'pci_requests' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG nova.objects.base [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Object Instance<55971d31-4c54-4150-bfbd-4636df306fbd> lazy-loaded attributes: flavor,pci_requests {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:42:27 user nova-compute[73052]: DEBUG nova.policy [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67f2f57480264fc5b15f17f7f94fc1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176dded2fa8441a194f131cbe8a4eefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lazy-loading 'flavor' on Instance uuid af3029db-dce7-4f4e-b907-630ac9ff72d0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Successfully created port: a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:28 user nova-compute[73052]: INFO nova.compute.manager [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Attaching volume ed309d2b-853e-4795-872f-14daba3d1e66 to /dev/sdc
Aug 26 14:42:28 user nova-compute[73052]: DEBUG os_brick.utils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e98bbf4-152a-4af5-a179-43efc0ddef2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a09d14-3f8b-4f23-879c-c1c76eaf61e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[666e0c0b-b513-4bec-aa37-f0cefb14c135]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4276e9f-9530-4979-996e-79478a745140]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:28 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:42:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9655d54e-121e-4331-8335-d5fa39002d66]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG os_brick.utils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Updating existing volume attachment record: 2841f00d-afd0-49df-9605-2367d4cbf706 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:42:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Successfully updated port: a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquired lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-78b38a6e-dba3-4b03-9e90-c2d447306929 req-32dfed7d-9f6f-4b4b-8c9c-5937da5abc05 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-changed-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-78b38a6e-dba3-4b03-9e90-c2d447306929 req-32dfed7d-9f6f-4b4b-8c9c-5937da5abc05 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Refreshing instance network info cache due to event network-changed-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-78b38a6e-dba3-4b03-9e90-c2d447306929 req-32dfed7d-9f6f-4b4b-8c9c-5937da5abc05 service nova] Acquiring lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-a3e0339e-a983-41a8-9d63-60b07a09d6ca req-6cb6602f-4d08-45d8-aaa4-2a919f36587a service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received event network-changed-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-a3e0339e-a983-41a8-9d63-60b07a09d6ca req-6cb6602f-4d08-45d8-aaa4-2a919f36587a service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Refreshing instance network info cache due to event network-changed-53db4fdc-63d5-4ca9-8e60-374c686017fa. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a3e0339e-a983-41a8-9d63-60b07a09d6ca req-6cb6602f-4d08-45d8-aaa4-2a919f36587a service nova] Acquiring lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a3e0339e-a983-41a8-9d63-60b07a09d6ca req-6cb6602f-4d08-45d8-aaa4-2a919f36587a service nova] Acquired lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-a3e0339e-a983-41a8-9d63-60b07a09d6ca req-6cb6602f-4d08-45d8-aaa4-2a919f36587a service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Refreshing network info cache for port 53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lazy-loading 'flavor' on Instance uuid fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:29 user nova-compute[73052]: INFO nova.compute.manager [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Attaching volume 792f8fb0-989e-4137-9720-28dcffc84b8f to /dev/vdb
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-a3e0339e-a983-41a8-9d63-60b07a09d6ca req-6cb6602f-4d08-45d8-aaa4-2a919f36587a service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Updated VIF entry in instance network info cache for port 53db4fdc-63d5-4ca9-8e60-374c686017fa. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-a3e0339e-a983-41a8-9d63-60b07a09d6ca req-6cb6602f-4d08-45d8-aaa4-2a919f36587a service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Updating instance_info_cache with network_info: [{"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a3e0339e-a983-41a8-9d63-60b07a09d6ca req-6cb6602f-4d08-45d8-aaa4-2a919f36587a service nova] Releasing lock "refresh_cache-fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[69542c59-8254-48db-8964-7ec578ddff60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[843b33cc-2685-4c2c-b630-5c39fc8c968d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[02586998-6ce8-4077-9559-0dcffb754f80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f155b4ac-30be-4cdb-ae87-9fc10276309f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:29 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:42:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b49f8-207e-470a-b07b-ad66031a53c6]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:29 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Updating existing volume attachment record: ef9e3275-0d7a-4dd5-ae55-fa72c1306524 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.network.neutron [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating instance_info_cache with network_info: [{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Releasing lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-78b38a6e-dba3-4b03-9e90-c2d447306929 req-32dfed7d-9f6f-4b4b-8c9c-5937da5abc05 service nova] Acquired lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.network.neutron [req-78b38a6e-dba3-4b03-9e90-c2d447306929 req-32dfed7d-9f6f-4b4b-8c9c-5937da5abc05 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Refreshing network info cache for port a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converting VIF {"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG os_vif [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa39ad84b-08, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa39ad84b-08, col_values=(('external_ids', {'iface-id': 'a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:70:90', 'vm-uuid': '55971d31-4c54-4150-bfbd-4636df306fbd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:30 user nova-compute[73052]: INFO os_vif [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08')
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converting VIF {"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] attach device xml: <interface type="ethernet">
Aug 26 14:42:30 user nova-compute[73052]:   <mac address="fa:16:3e:2b:70:90"/>
Aug 26 14:42:30 user nova-compute[73052]:   <model type="virtio"/>
Aug 26 14:42:30 user nova-compute[73052]:   <mtu size="1442"/>
Aug 26 14:42:30 user nova-compute[73052]:   <target dev="tapa39ad84b-08"/>
Aug 26 14:42:30 user nova-compute[73052]: </interface>
Aug 26 14:42:30 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-c9ce4758-ef12-459c-b0b3-1df8c69e12a5 req-e3f16093-b880-4ed5-b3f5-333c6e7900a3 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c9ce4758-ef12-459c-b0b3-1df8c69e12a5 req-e3f16093-b880-4ed5-b3f5-333c6e7900a3 service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c9ce4758-ef12-459c-b0b3-1df8c69e12a5 req-e3f16093-b880-4ed5-b3f5-333c6e7900a3 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c9ce4758-ef12-459c-b0b3-1df8c69e12a5 req-e3f16093-b880-4ed5-b3f5-333c6e7900a3 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-c9ce4758-ef12-459c-b0b3-1df8c69e12a5 req-e3f16093-b880-4ed5-b3f5-333c6e7900a3 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:30 user nova-compute[73052]: WARNING nova.compute.manager [req-c9ce4758-ef12-459c-b0b3-1df8c69e12a5 req-e3f16093-b880-4ed5-b3f5-333c6e7900a3 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a for instance with vm_state active and task_state None.
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.network.neutron [req-78b38a6e-dba3-4b03-9e90-c2d447306929 req-32dfed7d-9f6f-4b4b-8c9c-5937da5abc05 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updated VIF entry in instance network info cache for port a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.network.neutron [req-78b38a6e-dba3-4b03-9e90-c2d447306929 req-32dfed7d-9f6f-4b4b-8c9c-5937da5abc05 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating instance_info_cache with network_info: [{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-78b38a6e-dba3-4b03-9e90-c2d447306929 req-32dfed7d-9f6f-4b4b-8c9c-5937da5abc05 service nova] Releasing lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No BDM found with device name hda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No VIF found with MAC fa:16:3e:6e:74:c4, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:42:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:42:30 user nova-compute[73052]:   <nova:package version="0.0.0"/>
Aug 26 14:42:30 user nova-compute[73052]:   <nova:name>tempest-device-tagging-server-938538042</nova:name>
Aug 26 14:42:30 user nova-compute[73052]:   <nova:creationTime>2023-08-26 14:42:30</nova:creationTime>
Aug 26 14:42:30 user nova-compute[73052]:   <nova:flavor name="m1.tiny">
Aug 26 14:42:30 user nova-compute[73052]:     <nova:memory>512</nova:memory>
Aug 26 14:42:30 user nova-compute[73052]:     <nova:disk>1</nova:disk>
Aug 26 14:42:30 user nova-compute[73052]:     <nova:swap>0</nova:swap>
Aug 26 14:42:30 user nova-compute[73052]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:42:30 user nova-compute[73052]:     <nova:vcpus>1</nova:vcpus>
Aug 26 14:42:30 user nova-compute[73052]:   </nova:flavor>
Aug 26 14:42:30 user nova-compute[73052]:   <nova:owner>
Aug 26 14:42:30 user nova-compute[73052]:     <nova:user uuid="67f2f57480264fc5b15f17f7f94fc1a1">tempest-TaggedAttachmentsTest-395402729-project-member</nova:user>
Aug 26 14:42:30 user nova-compute[73052]:     <nova:project uuid="176dded2fa8441a194f131cbe8a4eefe">tempest-TaggedAttachmentsTest-395402729</nova:project>
Aug 26 14:42:30 user nova-compute[73052]:   </nova:owner>
Aug 26 14:42:30 user nova-compute[73052]:   <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:42:30 user nova-compute[73052]:   <nova:ports>
Aug 26 14:42:30 user nova-compute[73052]:     <nova:port uuid="64d1aab0-95f3-4ac4-bb41-cc97c1d5365e">
Aug 26 14:42:30 user nova-compute[73052]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:42:30 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:30 user nova-compute[73052]:     <nova:port uuid="a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a">
Aug 26 14:42:30 user nova-compute[73052]:       <nova:ip type="fixed" address="10.10.10.146" ipVersion="4"/>
Aug 26 14:42:30 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:30 user nova-compute[73052]:   </nova:ports>
Aug 26 14:42:30 user nova-compute[73052]: </nova:instance>
Aug 26 14:42:30 user nova-compute[73052]:  {{(pid=73052) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 14:42:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07ce1860-4dc5-4b2e-9c4a-d2de3b64e56b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "interface-55971d31-4c54-4150-bfbd-4636df306fbd-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.069s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-e430bf59-d481-47fc-abcc-f8dec08b8358 req-3ffb0822-d218-4e9e-b676-0ffa637368de service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e430bf59-d481-47fc-abcc-f8dec08b8358 req-3ffb0822-d218-4e9e-b676-0ffa637368de service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e430bf59-d481-47fc-abcc-f8dec08b8358 req-3ffb0822-d218-4e9e-b676-0ffa637368de service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e430bf59-d481-47fc-abcc-f8dec08b8358 req-3ffb0822-d218-4e9e-b676-0ffa637368de service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-e430bf59-d481-47fc-abcc-f8dec08b8358 req-3ffb0822-d218-4e9e-b676-0ffa637368de service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:32 user nova-compute[73052]: WARNING nova.compute.manager [req-e430bf59-d481-47fc-abcc-f8dec08b8358 req-3ffb0822-d218-4e9e-b676-0ffa637368de service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a for instance with vm_state active and task_state None.
Aug 26 14:42:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-cc88c366-cc01-4538-ae5c-2f30f0982b36 req-3c3e3700-dac6-4056-93e0-e47c2ffc7867 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received event network-changed-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-cc88c366-cc01-4538-ae5c-2f30f0982b36 req-3c3e3700-dac6-4056-93e0-e47c2ffc7867 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Refreshing instance network info cache due to event network-changed-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:42:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc88c366-cc01-4538-ae5c-2f30f0982b36 req-3c3e3700-dac6-4056-93e0-e47c2ffc7867 service nova] Acquiring lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc88c366-cc01-4538-ae5c-2f30f0982b36 req-3c3e3700-dac6-4056-93e0-e47c2ffc7867 service nova] Acquired lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:34 user nova-compute[73052]: DEBUG nova.network.neutron [req-cc88c366-cc01-4538-ae5c-2f30f0982b36 req-3c3e3700-dac6-4056-93e0-e47c2ffc7867 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Refreshing network info cache for port 91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:42:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:35 user nova-compute[73052]: DEBUG nova.network.neutron [req-cc88c366-cc01-4538-ae5c-2f30f0982b36 req-3c3e3700-dac6-4056-93e0-e47c2ffc7867 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Updated VIF entry in instance network info cache for port 91ba2e98-54ab-4357-b08d-edaf5bf4cfd6. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:42:35 user nova-compute[73052]: DEBUG nova.network.neutron [req-cc88c366-cc01-4538-ae5c-2f30f0982b36 req-3c3e3700-dac6-4056-93e0-e47c2ffc7867 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Updating instance_info_cache with network_info: [{"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc88c366-cc01-4538-ae5c-2f30f0982b36 req-3c3e3700-dac6-4056-93e0-e47c2ffc7867 service nova] Releasing lock "refresh_cache-bb7d8ce2-141a-4ba9-b545-858875307ff0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rAxLlPbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:39 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:39 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:39 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3147e4-0fb5-416a-80d2-8352c532a8e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:42:39 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f247fa-176a-451b-b401-22ba756b4cb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66] added
Aug 26 14:42:39 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd17d1-d97b-44ee-9999-262032123c77]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[48406e56-4e7e-4208-a85e-fac1d483ec19]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rAxLlPbT {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rAxLlPbT" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a76c638-e32b-4dcf-9c84-15cd80f57420]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rAxLlPbT'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c27ae3-1b08-452c-a142-189da328e42e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b5e03f-4958-4d86-8e02-065b90c5e870]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:39 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:39 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdbb8c6-26e1-43d9-b54d-c832006ef2bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66, portal: 172.16.0.220,3260]
Aug 26 14:42:39 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:39 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3c841e-898c-4448-a006-1a344d25c1da]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lazy-loading 'flavor' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d02be73-d646-4baf-b5fa-47c265418557]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:40 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:40 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f22ee6-6d89-4a48-88e1-70d0b47413ee]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rAxLlPbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lazy-loading 'flavor' on Instance uuid bb7d8ce2-141a-4ba9-b545-858875307ff0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:40 user nova-compute[73052]: INFO nova.compute.manager [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Attaching volume b6d167bf-493f-459f-b580-b66941d863d7 to /dev/vdb
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:40 user nova-compute[73052]: INFO nova.compute.manager [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Attaching volume 298d3550-fb12-4754-bec1-b557fe19e4f8 to /dev/vdb
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.utils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa82d1f-35aa-4224-bf9b-8789d85a8d24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.utils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abcff8d-d1ae-4a2a-b59c-46aaa2f8e7d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[70435141-a999-4587-b2c6-bbf1e17ceab9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58b64f-ed9e-47b8-a325-b6e7012f8ea9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4291aa52-4c50-4573-a55c-56143db96726]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[94793e9c-4b68-4307-afb0-824d06b11061]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:40 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6e4068-77b7-4055-8cac-c9b92a589b8b]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.utils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating existing volume attachment record: 33efd610-70e9-4901-b3ab-dab57fa143ed {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c28d0f-343f-4c31-ad38-f1e343ab2fef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[213e2aad-7daf-4c2f-8039-9cd9ee9c2a90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:40 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:42:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c72e0cd-f948-44f4-85a2-121a1fe3ae32]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG os_brick.utils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:40 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Updating existing volume attachment record: 029b0918-55d5-46df-bf48-c4a042f60e4c {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23965303062363062', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965303062363062', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lazy-loading 'flavor' on Instance uuid af3029db-dce7-4f4e-b907-630ac9ff72d0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:42:41 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:41 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:42:41 user nova-compute[73052]:   <target dev="sdc" bus="scsi"/>
Aug 26 14:42:41 user nova-compute[73052]:   <serial>ed309d2b-853e-4795-872f-14daba3d1e66</serial>
Aug 26 14:42:41 user nova-compute[73052]:   <address type="drive" controller="0" unit="2"/>
Aug 26 14:42:41 user nova-compute[73052]: </disk>
Aug 26 14:42:41 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:41 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:41 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:41 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c762629-0bfc-4048-a647-fd8cea80a3ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:42:41 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[160a11d7-b106-4159-805b-dcde7cea4a1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f] added
Aug 26 14:42:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2115281-7367-451e-b55d-d6c81976c110]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a7faf-0a78-4451-b275-7f839d11fe48]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqEicdsV {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqEicdsV" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fa1713-f8d2-449b-9f70-297493331baf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LqEicdsV'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae38d15-f426-4ba2-8382-ca9efc5a3638]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ed31ec-8347-4fe1-b6e1-de2196745e47]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:41 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:41 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[47db3a23-f789-4be1-a8b2-9e490654877c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260]
Aug 26 14:42:41 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3c7b8f-ab64-4d9c-8a53-f39048f62125]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f5d4fa-025f-4bf5-8e97-5d20cbb6cc9e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:41 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:41 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:41 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:41 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3613c456-f6ea-4a2d-94a0-83f1dc180ec9]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] No BDM found with device name sda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] No VIF found with MAC fa:16:3e:33:70:19, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNEHuUfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:41 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7665bbe4-0736-4ffe-aaf3-e5f1a0ea674f tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.791s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26366316439313739', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366316439313739', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.651s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:42 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:42 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG nova.objects.instance [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lazy-loading 'flavor' on Instance uuid fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6fc3fe-ed14-43b7-b8d0-5e7caa9402a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:42:42 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:42:42 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:42 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:42:42 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:42 user nova-compute[73052]:   <serial>792f8fb0-989e-4137-9720-28dcffc84b8f</serial>
Aug 26 14:42:42 user nova-compute[73052]: </disk>
Aug 26 14:42:42 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26246a-3806-4524-9c37-66b7571cae81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834] added
Aug 26 14:42:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc161ee-4533-4d4d-ad6c-1d7df4fb3705]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e34715-d469-47ab-9cfc-340118608c57]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNEHuUfP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNEHuUfP" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a4ef9-53e5-48cb-b518-38b892482c9a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNEHuUfP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd8d93e-2c7e-4a21-aef9-67681f5370e1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[edac8cb3-5903-40c3-87b2-bfe6360ab592]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d379422c-83fe-47b5-a0f6-1fbde994e9dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: INFO nova.compute.manager [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Detaching volume ed309d2b-853e-4795-872f-14daba3d1e66
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834, portal: 172.16.0.220,3260]
Aug 26 14:42:42 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3b23b2-dd6e-497c-bb71-cca08828b2ab]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa179bf1-c936-4999-b5fa-c1234a1484bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:42 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:42:42 user nova-compute[73052]: INFO nova.virt.block_device [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Attempting to driver detach volume ed309d2b-853e-4795-872f-14daba3d1e66 from mountpoint /dev/sdc
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Attempting to detach device sdc from instance af3029db-dce7-4f4e-b907-630ac9ff72d0 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:42:42 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:42 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:42:42 user nova-compute[73052]:   <target dev="sdc" bus="scsi"/>
Aug 26 14:42:42 user nova-compute[73052]:   <serial>ed309d2b-853e-4795-872f-14daba3d1e66</serial>
Aug 26 14:42:42 user nova-compute[73052]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 14:42:42 user nova-compute[73052]: </disk>
Aug 26 14:42:42 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe88ed63-5aee-435d-a0b1-4c2fd8c1bfcb]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNEHuUfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:42:42 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Successfully detached device sdc from instance af3029db-dce7-4f4e-b907-630ac9ff72d0 from the persistent domain config.
Aug 26 14:42:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance af3029db-dce7-4f4e-b907-630ac9ff72d0 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:42:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:42:42 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:42 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:42:42 user nova-compute[73052]:   <target dev="sdc" bus="scsi"/>
Aug 26 14:42:42 user nova-compute[73052]:   <serial>ed309d2b-853e-4795-872f-14daba3d1e66</serial>
Aug 26 14:42:42 user nova-compute[73052]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 14:42:42 user nova-compute[73052]: </disk>
Aug 26 14:42:42 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] No VIF found with MAC fa:16:3e:20:dd:cc, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-41926cf0-54dc-4d59-8629-eb4ccbb3484b tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.589s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693060963.3845742, af3029db-dce7-4f4e-b907-630ac9ff72d0 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance af3029db-dce7-4f4e-b907-630ac9ff72d0 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:42:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Successfully detached device sdc from instance af3029db-dce7-4f4e-b907-630ac9ff72d0 from the live domain config.
Aug 26 14:42:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rAxLlPbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:43 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] <== connect_volume: return (2012ms) {'type': 'block', 'scsi_wwn': '26135326336303030', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135326336303030', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.568s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lazy-loading 'flavor' on Instance uuid acb26430-b816-4969-b379-720e98cf59e6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb1b98d-f334-4f28-a329-00d6979c6ee2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:42:44 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:44 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:42:44 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:44 user nova-compute[73052]:   <serial>b282f9f9-e1b2-44f6-a362-7c6086af5834</serial>
Aug 26 14:42:44 user nova-compute[73052]: </disk>
Aug 26 14:42:44 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d66e2df-2745-4819-9da2-338f3cf13e4d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:44 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:44 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:44 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:44 user nova-compute[73052]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 (non-flash)
Aug 26 14:42:44 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:44 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee565281-c5b9-4ad0-8b16-e45721b6b8e9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fa0443-69ae-4772-9e05-4296e673ffa7]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[67061ee8-61cb-4b19-afb3-79cbfb404a77]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a315a38c-c0f7-4c23-a3ae-d446180a75d8]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8d6f94-3d5c-4af8-9324-c272cbe08801]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc4a79e-21f6-4458-909c-cb8323cd23ee]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66, portal: 172.16.0.220,3260]
Aug 26 14:42:44 user nova-compute[73052]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed309d2b-853e-4795-872f-14daba3d1e66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[104b9e95-ccd7-4cdc-9257-8df6ac2a7784]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] <== disconnect_volume: return (856ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] No VIF found with MAC fa:16:3e:11:3b:26, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:42:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lazy-loading 'flavor' on Instance uuid af3029db-dce7-4f4e-b907-630ac9ff72d0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8f58f8fd-4bab-4297-ae28-b2ceb5e02714 tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.482s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b3e1c62c-0c8f-4845-9207-76abf51060ae tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.673s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:46 user nova-compute[73052]: INFO nova.compute.manager [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Terminating instance
Aug 26 14:42:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG os_brick.utils [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f037820-5d2a-4416-afa4-d5ab996fcc75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d296f2f-64ee-46e9-9a9c-aa4c3fa807b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[20127f33-579d-44ea-bec8-6708c13ce5a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdce396-d5e1-4d16-88ff-8a493392fb7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:42:46 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbcff6a-4199-41a8-956d-f5daa3c2e236]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG os_brick.utils [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:46 user nova-compute[73052]: INFO nova.compute.manager [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Swapping volume 792f8fb0-989e-4137-9720-28dcffc84b8f for cd6fbe75-df86-4283-a5ac-7c28f9e66854
Aug 26 14:42:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-a80c210d-4ce4-486c-86b7-bcefbd7b7c10 req-a30be7a7-e8ea-4bb2-87ee-cba11a97fe1b service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received event network-vif-unplugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a80c210d-4ce4-486c-86b7-bcefbd7b7c10 req-a30be7a7-e8ea-4bb2-87ee-cba11a97fe1b service nova] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a80c210d-4ce4-486c-86b7-bcefbd7b7c10 req-a30be7a7-e8ea-4bb2-87ee-cba11a97fe1b service nova] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a80c210d-4ce4-486c-86b7-bcefbd7b7c10 req-a30be7a7-e8ea-4bb2-87ee-cba11a97fe1b service nova] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-a80c210d-4ce4-486c-86b7-bcefbd7b7c10 req-a30be7a7-e8ea-4bb2-87ee-cba11a97fe1b service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] No waiting events found dispatching network-vif-unplugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-a80c210d-4ce4-486c-86b7-bcefbd7b7c10 req-a30be7a7-e8ea-4bb2-87ee-cba11a97fe1b service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received event network-vif-unplugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:42:47 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Instance destroyed successfully.
Aug 26 14:42:47 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lazy-loading 'resources' on Instance uuid af3029db-dce7-4f4e-b907-630ac9ff72d0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-130769244',display_name='tempest-AttachSCSIVolumeTestJSON-server-130769244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-130769244',id=6,image_ref='aebb908d-bf2c-4713-9c9c-2f8383ed9801',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsUK9uWiRbXsWXRrSAynWP4F0XdQ3hwCBrhU8PXLHZqWDQWYe/U6Hnh7F2x0gw5EjFyzmYclzQv8fVI9abRlPV7MMHGWoDPQc0OaDnwV5yP3FPcYvSrJi0NavD1KoSorg==',key_name='tempest-keypair-277411448',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61b0341c594e4a6890624f3edd2e3349',ramdisk_id='',reservation_id='r-bzcxili8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='aebb908d-bf2c-4713-9c9c-2f8383ed9801',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1155282523',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1155282523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d0e6376d89d498db22fccd1ce9da246',uuid=af3029db-dce7-4f4e-b907-630ac9ff72d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Converting VIF {"id": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "address": "fa:16:3e:33:70:19", "network": {"id": "0b073da5-6268-4b27-b9fa-1ec1a218ef77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1352363190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61b0341c594e4a6890624f3edd2e3349", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c5ce06-c5", "ovs_interfaceid": "16c5ce06-c50f-443d-9bb8-884fe5e5c929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:70:19,bridge_name='br-int',has_traffic_filtering=True,id=16c5ce06-c50f-443d-9bb8-884fe5e5c929,network=Network(0b073da5-6268-4b27-b9fa-1ec1a218ef77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c5ce06-c5') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG os_vif [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:70:19,bridge_name='br-int',has_traffic_filtering=True,id=16c5ce06-c50f-443d-9bb8-884fe5e5c929,network=Network(0b073da5-6268-4b27-b9fa-1ec1a218ef77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c5ce06-c5') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16c5ce06-c5, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:42:47 user nova-compute[73052]: INFO os_vif [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:70:19,bridge_name='br-int',has_traffic_filtering=True,id=16c5ce06-c50f-443d-9bb8-884fe5e5c929,network=Network(0b073da5-6268-4b27-b9fa-1ec1a218ef77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c5ce06-c5')
Aug 26 14:42:47 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Deleting instance files /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0_del
Aug 26 14:42:47 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Deletion of /opt/stack/data/nova/instances/af3029db-dce7-4f4e-b907-630ac9ff72d0_del complete
Aug 26 14:42:47 user nova-compute[73052]: INFO nova.compute.manager [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 14:42:47 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:42:47 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:42:48 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:48 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Took 1.44 seconds to deallocate network for instance.
Aug 26 14:42:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-d1648cb9-c252-4eb4-bc2a-432ce0b2a930 req-eef48c99-7024-4002-937e-24f122bf3df0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received event network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1648cb9-c252-4eb4-bc2a-432ce0b2a930 req-eef48c99-7024-4002-937e-24f122bf3df0 service nova] Acquiring lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1648cb9-c252-4eb4-bc2a-432ce0b2a930 req-eef48c99-7024-4002-937e-24f122bf3df0 service nova] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1648cb9-c252-4eb4-bc2a-432ce0b2a930 req-eef48c99-7024-4002-937e-24f122bf3df0 service nova] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-d1648cb9-c252-4eb4-bc2a-432ce0b2a930 req-eef48c99-7024-4002-937e-24f122bf3df0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] No waiting events found dispatching network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:48 user nova-compute[73052]: WARNING nova.compute.manager [req-d1648cb9-c252-4eb4-bc2a-432ce0b2a930 req-eef48c99-7024-4002-937e-24f122bf3df0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received unexpected event network-vif-plugged-16c5ce06-c50f-443d-9bb8-884fe5e5c929 for instance with vm_state deleted and task_state None.
Aug 26 14:42:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-d1648cb9-c252-4eb4-bc2a-432ce0b2a930 req-eef48c99-7024-4002-937e-24f122bf3df0 service nova] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Received event network-vif-deleted-16c5ce06-c50f-443d-9bb8-884fe5e5c929 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:49 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:42:49 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:42:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:49 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Deleted allocations for instance af3029db-dce7-4f4e-b907-630ac9ff72d0
Aug 26 14:42:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a3ae39d-df6b-4606-a4cc-fb2a6433e98b tempest-AttachSCSIVolumeTestJSON-1155282523 tempest-AttachSCSIVolumeTestJSON-1155282523-project-member] Lock "af3029db-dce7-4f4e-b907-630ac9ff72d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.029s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:42:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIRqeGCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:52 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c74dcad-640e-473a-a84b-0093319fdd3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:42:53 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d1e34b-60f7-4449-a46c-d89c54ab6e8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7] added
Aug 26 14:42:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a0f9a0-6a02-43f2-baad-ff2e2e1acaa6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f1d87f-86d3-47ec-b3bc-cf51b90b5298]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DIRqeGCu {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DIRqeGCu" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[75466fde-6110-406a-be31-245a1e4bb344]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DIRqeGCu'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d397a-6b14-4c6a-b937-7a076db3561b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1957f0-557f-4c92-b9ba-bbaf0cae6285]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da6807-e178-4c63-8014-d5ab1973065f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7, portal: 172.16.0.220,3260]
Aug 26 14:42:53 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62dadf-0bec-4d6a-9fbb-de5ce5c9277d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d317b0-85a4-45c9-bd75-c96781520ded]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:53 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXzVPBYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:53 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fe98b2-a55f-48b7-b47f-8cc6255e804d]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIRqeGCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:53 user nova-compute[73052]: INFO nova.compute.manager [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Detaching volume b282f9f9-e1b2-44f6-a362-7c6086af5834
Aug 26 14:42:53 user nova-compute[73052]: INFO nova.virt.block_device [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Attempting to driver detach volume b282f9f9-e1b2-44f6-a362-7c6086af5834 from mountpoint /dev/vdb
Aug 26 14:42:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Attempting to detach device vdb from instance acb26430-b816-4969-b379-720e98cf59e6 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:42:53 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:53 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:42:53 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:53 user nova-compute[73052]:   <serial>b282f9f9-e1b2-44f6-a362-7c6086af5834</serial>
Aug 26 14:42:53 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:42:53 user nova-compute[73052]: </disk>
Aug 26 14:42:53 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:53 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Successfully detached device vdb from instance acb26430-b816-4969-b379-720e98cf59e6 from the persistent domain config.
Aug 26 14:42:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance acb26430-b816-4969-b379-720e98cf59e6 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:42:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:42:53 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:53 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:42:53 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:53 user nova-compute[73052]:   <serial>b282f9f9-e1b2-44f6-a362-7c6086af5834</serial>
Aug 26 14:42:53 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:42:53 user nova-compute[73052]: </disk>
Aug 26 14:42:53 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693060974.304923, acb26430-b816-4969-b379-720e98cf59e6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance acb26430-b816-4969-b379-720e98cf59e6 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:42:54 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Successfully detached device vdb from instance acb26430-b816-4969-b379-720e98cf59e6 from the live domain config.
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNEHuUfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23462336463316233', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462336463316233', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.017s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:54 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lazy-loading 'flavor' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece25134-6315-41dd-b0d2-e42edd1f1940]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:42:54 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:42:54 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:54 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:42:54 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:54 user nova-compute[73052]:   <serial>b6d167bf-493f-459f-b580-b66941d863d7</serial>
Aug 26 14:42:54 user nova-compute[73052]: </disk>
Aug 26 14:42:54 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[46432795-e135-46ee-a027-ae3e55a7e923]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8] added
Aug 26 14:42:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516ae66-c411-4b1f-be20-f28d0faba8bf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91970e-6bdf-4f2c-999c-f36f718bc4dd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXzVPBYl {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXzVPBYl" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5fb8c1-ab04-4aa1-ba66-a79bcf077cad]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZXzVPBYl'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a46512e-e7aa-4899-bae0-a5877c88d8ec]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bff69c-7fe8-4a19-8688-aa53c7740da9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca1d432-4752-4564-8106-2a065371582d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8, portal: 172.16.0.220,3260]
Aug 26 14:42:54 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb8c29f-c349-4c44-8aa0-91d3fb55382e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbf10d2-e9e5-4170-bad9-9e44da98a97a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb40289-e52a-4ceb-b6de-25b82b525dae]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No BDM found with device name hda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] No VIF found with MAC fa:16:3e:6e:74:c4, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4e25ca15-57f1-45f0-80fc-b38f9f69b43b tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.569s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXzVPBYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] <== connect_volume: return (2351ms) {'type': 'block', 'scsi_wwn': '23234363665373738', 'path': '/dev/sdf'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234363665373738', 'path': '/dev/sdf'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.348s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lazy-loading 'flavor' on Instance uuid bb7d8ce2-141a-4ba9-b545-858875307ff0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df8e26-937e-4e62-8d31-a891f6a44802]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[407550c3-d4af-4d4d-8586-723c3b16fd46]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:55 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:55 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:55 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:55 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:55 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:55 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:55 user nova-compute[73052]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 (non-flash)
Aug 26 14:42:55 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:55 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:55 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0446e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 14:42:55 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:55 user nova-compute[73052]:   <source dev="/dev/sdf"/>
Aug 26 14:42:55 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:55 user nova-compute[73052]:   <serial>298d3550-fb12-4754-bec1-b557fe19e4f8</serial>
Aug 26 14:42:55 user nova-compute[73052]: </disk>
Aug 26 14:42:55 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f20207-35fd-4a56-8dff-5b8297a0c94f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[35733d8a-d0c2-4ca5-afd6-2dacacd24628]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f677fa0-61e1-4999-9569-0b3ab8d4f2fa]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c423238-7856-40e3-a79a-3dda9bd16e9f]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29af800-dc50-4a28-bd0e-b8cb91a64a47]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[87054439-1b73-4002-b028-3b4edfba08ef]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834, portal: 172.16.0.220,3260]
Aug 26 14:42:55 user nova-compute[73052]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:55 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b282f9f9-e1b2-44f6-a362-7c6086af5834 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4dcde7-e002-4693-8ddb-87d8345d3861]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] <== disconnect_volume: return (1687ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:56 user nova-compute[73052]: INFO nova.compute.manager [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Detaching volume b6d167bf-493f-459f-b580-b66941d863d7
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] No VIF found with MAC fa:16:3e:22:6b:02, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:42:56 user nova-compute[73052]: INFO nova.virt.block_device [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Attempting to driver detach volume b6d167bf-493f-459f-b580-b66941d863d7 from mountpoint /dev/vdb
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Attempting to detach device vdb from instance 55971d31-4c54-4150-bfbd-4636df306fbd from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:42:56 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:56 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:42:56 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:56 user nova-compute[73052]:   <serial>b6d167bf-493f-459f-b580-b66941d863d7</serial>
Aug 26 14:42:56 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 14:42:56 user nova-compute[73052]: </disk>
Aug 26 14:42:56 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Successfully detached device vdb from instance 55971d31-4c54-4150-bfbd-4636df306fbd from the persistent domain config.
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55971d31-4c54-4150-bfbd-4636df306fbd from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:42:56 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:56 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:42:56 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:56 user nova-compute[73052]:   <serial>b6d167bf-493f-459f-b580-b66941d863d7</serial>
Aug 26 14:42:56 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 14:42:56 user nova-compute[73052]: </disk>
Aug 26 14:42:56 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0286a8ea-b17c-4cfb-ae8c-0c19a50d5e68 tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.847s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693060976.8390515, 55971d31-4c54-4150-bfbd-4636df306fbd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:42:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Successfully detached device vdb from instance 55971d31-4c54-4150-bfbd-4636df306fbd from the live domain config.
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIRqeGCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:56 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70e89e-12ee-4aab-b651-f91b1dbb468d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746d5fa-041e-4f6e-ad5d-c3cfbf459816]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:56 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:56 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:56 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:56 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:56 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:56 user nova-compute[73052]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 (non-flash)
Aug 26 14:42:56 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:56 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lazy-loading 'flavor' on Instance uuid acb26430-b816-4969-b379-720e98cf59e6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddfcaa9-4e50-4fe5-ab85-c1969787566c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a90f5b-192a-484a-ac37-28954b6832b8]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[65028e56-5299-4f73-a398-0666b8735486]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bb879108-809b-4c58-8be9-bbe885443f16 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.233s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f4b536-2eb0-4673-8c33-2e08fd797da2]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb99701-cd2e-4dcd-af24-b0889a032233]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35f3b9-c0eb-4d06-bd93-e0416a35df4a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7, portal: 172.16.0.220,3260]
Aug 26 14:42:57 user nova-compute[73052]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:57 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d167bf-493f-459f-b580-b66941d863d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d972a4-7e91-4098-bf2d-5dec503a01fe]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] <== disconnect_volume: return (298ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e06ace59-ad4e-4c0c-8728-a916f90e9a6b tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] volume_snapshot_create: create_info: {'snapshot_id': 'b1826f01-2767-4874-8044-c14726a98c3e', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73052) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e06ace59-ad4e-4c0c-8728-a916f90e9a6b tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] snap xml: <domainsnapshot>
Aug 26 14:42:57 user nova-compute[73052]:   <disks>
Aug 26 14:42:57 user nova-compute[73052]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 26 14:42:57 user nova-compute[73052]:       <source file="/dev/new_file"/>
Aug 26 14:42:57 user nova-compute[73052]:     </disk>
Aug 26 14:42:57 user nova-compute[73052]:     <disk name="vda" snapshot="no"/>
Aug 26 14:42:57 user nova-compute[73052]:   </disks>
Aug 26 14:42:57 user nova-compute[73052]: </domainsnapshot>
Aug 26 14:42:57 user nova-compute[73052]:  {{(pid=73052) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 14:42:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e06ace59-ad4e-4c0c-8728-a916f90e9a6b tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] Lazy-loading 'system_metadata' on Instance uuid bb7d8ce2-141a-4ba9-b545-858875307ff0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e06ace59-ad4e-4c0c-8728-a916f90e9a6b tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [None req-e06ace59-ad4e-4c0c-8728-a916f90e9a6b tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     rv = execute(f, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     six.reraise(c, e, tb)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     raise value
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     rv = meth(*args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [None req-e06ace59-ad4e-4c0c-8728-a916f90e9a6b tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     self._volume_snapshot_create(context, instance, guest,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     rv = execute(f, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     six.reraise(c, e, tb)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     raise value
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     rv = meth(*args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] 
Aug 26 14:42:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3c5566d5-e2ed-455c-8ae2-b99a519f0733 tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] volume_snapshot_delete: delete_info: {'volume_id': '298d3550-fb12-4754-bec1-b557fe19e4f8'} {{(pid=73052) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [None req-3c5566d5-e2ed-455c-8ae2-b99a519f0733 tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0]     if delete_info['type'] != 'qcow2':
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] KeyError: 'type'
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [None req-e06ace59-ad4e-4c0c-8728-a916f90e9a6b tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b1826f01-2767-4874-8044-c14726a98c3e could not be found.
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b1826f01-2767-4874-8044-c14726a98c3e could not be found. (HTTP 404) (Request-ID: req-97745250-7c5f-4c3c-a214-4e39b74e1e18)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b1826f01-2767-4874-8044-c14726a98c3e could not be found.
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server [None req-e06ace59-ad4e-4c0c-8728-a916f90e9a6b tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 14:42:57 user nova-compute[73052]: ERROR oslo_messaging.rpc.server 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver [None req-3c5566d5-e2ed-455c-8ae2-b99a519f0733 tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-7128ee7b-e7f6-40fd-9b2d-94314eeb9469)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 14:42:57 user nova-compute[73052]: ERROR nova.virt.libvirt.driver 
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server [None req-3c5566d5-e2ed-455c-8ae2-b99a519f0733 tempest-VolumesAssistedSnapshotsTest-166600852 tempest-VolumesAssistedSnapshotsTest-166600852-project] Exception during message handling: KeyError: 'type'
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 14:42:58 user nova-compute[73052]: ERROR oslo_messaging.rpc.server 
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.objects.instance [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lazy-loading 'flavor' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-99a48c7a-f85d-4f20-bae2-93ca8cb82d2c tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.011s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:58 user nova-compute[73052]: INFO nova.compute.manager [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Detaching volume 298d3550-fb12-4754-bec1-b557fe19e4f8
Aug 26 14:42:58 user nova-compute[73052]: INFO nova.virt.block_device [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Attempting to driver detach volume 298d3550-fb12-4754-bec1-b557fe19e4f8 from mountpoint /dev/vdb
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Attempting to detach device vdb from instance bb7d8ce2-141a-4ba9-b545-858875307ff0 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 14:42:58 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:58 user nova-compute[73052]:   <source dev="/dev/sdf"/>
Aug 26 14:42:58 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:58 user nova-compute[73052]:   <serial>298d3550-fb12-4754-bec1-b557fe19e4f8</serial>
Aug 26 14:42:58 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:42:58 user nova-compute[73052]: </disk>
Aug 26 14:42:58 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Successfully detached device vdb from instance bb7d8ce2-141a-4ba9-b545-858875307ff0 from the persistent domain config.
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb7d8ce2-141a-4ba9-b545-858875307ff0 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 14:42:58 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:42:58 user nova-compute[73052]:   <source dev="/dev/sdf"/>
Aug 26 14:42:58 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:42:58 user nova-compute[73052]:   <serial>298d3550-fb12-4754-bec1-b557fe19e4f8</serial>
Aug 26 14:42:58 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:42:58 user nova-compute[73052]: </disk>
Aug 26 14:42:58 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "interface-55971d31-4c54-4150-bfbd-4636df306fbd-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "interface-55971d31-4c54-4150-bfbd-4636df306fbd-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.objects.instance [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lazy-loading 'flavor' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converting VIF {"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface> {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBnvCYxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc07b8f2-3c64-4de9-a0a4-55121f6a90c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd6fbe75-df86-4283-a5ac-7c28f9e66854', 'serial': 'cd6fbe75-df86-4283-a5ac-7c28f9e66854'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fc07b8f2-3c64-4de9-a0a4-55121f6a90c9', 'attached_at': '', 'detached_at': '', 'volume_id': '792f8fb0-989e-4137-9720-28dcffc84b8f', 'serial'} {{(pid=73052) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface> {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Attempting to detach device tapa39ad84b-08 from instance 55971d31-4c54-4150-bfbd-4636df306fbd from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] detach device xml: <interface type="ethernet">
Aug 26 14:42:58 user nova-compute[73052]:   <mac address="fa:16:3e:2b:70:90"/>
Aug 26 14:42:58 user nova-compute[73052]:   <model type="virtio"/>
Aug 26 14:42:58 user nova-compute[73052]:   <mtu size="1442"/>
Aug 26 14:42:58 user nova-compute[73052]:   <target dev="tapa39ad84b-08"/>
Aug 26 14:42:58 user nova-compute[73052]: </interface>
Aug 26 14:42:58 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBnvCYxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:58 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:58 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:58 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface> {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 26 14:42:58 user nova-compute[73052]:   <name>instance-00000007</name>
Aug 26 14:42:58 user nova-compute[73052]:   <uuid>55971d31-4c54-4150-bfbd-4636df306fbd</uuid>
Aug 26 14:42:58 user nova-compute[73052]:   <metadata>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:42:58 user nova-compute[73052]:   <nova:package version="0.0.0"/>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:name>tempest-device-tagging-server-938538042</nova:name>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:creationTime>2023-08-26 14:42:30</nova:creationTime>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:flavor name="m1.tiny">
Aug 26 14:42:58 user nova-compute[73052]:     <nova:memory>512</nova:memory>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:disk>1</nova:disk>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:swap>0</nova:swap>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:vcpus>1</nova:vcpus>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:flavor>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:owner>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:user uuid="67f2f57480264fc5b15f17f7f94fc1a1">tempest-TaggedAttachmentsTest-395402729-project-member</nova:user>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:project uuid="176dded2fa8441a194f131cbe8a4eefe">tempest-TaggedAttachmentsTest-395402729</nova:project>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:owner>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:ports>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:port uuid="64d1aab0-95f3-4ac4-bb41-cc97c1d5365e">
Aug 26 14:42:58 user nova-compute[73052]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:42:58 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:port uuid="a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a">
Aug 26 14:42:58 user nova-compute[73052]:       <nova:ip type="fixed" address="10.10.10.146" ipVersion="4"/>
Aug 26 14:42:58 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:ports>
Aug 26 14:42:58 user nova-compute[73052]: </nova:instance>
Aug 26 14:42:58 user nova-compute[73052]:   </metadata>
Aug 26 14:42:58 user nova-compute[73052]:   <memory unit='KiB'>524288</memory>
Aug 26 14:42:58 user nova-compute[73052]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 14:42:58 user nova-compute[73052]:   <vcpu placement='static'>1</vcpu>
Aug 26 14:42:58 user nova-compute[73052]:   <resource>
Aug 26 14:42:58 user nova-compute[73052]:     <partition>/machine</partition>
Aug 26 14:42:58 user nova-compute[73052]:   </resource>
Aug 26 14:42:58 user nova-compute[73052]:   <sysinfo type='smbios'>
Aug 26 14:42:58 user nova-compute[73052]:     <system>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='version'>0.0.0</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='serial'>55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='uuid'>55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='family'>Virtual Machine</entry>
Aug 26 14:42:58 user nova-compute[73052]:     </system>
Aug 26 14:42:58 user nova-compute[73052]:   </sysinfo>
Aug 26 14:42:58 user nova-compute[73052]:   <os>
Aug 26 14:42:58 user nova-compute[73052]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 14:42:58 user nova-compute[73052]:     <boot dev='hd'/>
Aug 26 14:42:58 user nova-compute[73052]:     <smbios mode='sysinfo'/>
Aug 26 14:42:58 user nova-compute[73052]:   </os>
Aug 26 14:42:58 user nova-compute[73052]:   <features>
Aug 26 14:42:58 user nova-compute[73052]:     <acpi/>
Aug 26 14:42:58 user nova-compute[73052]:     <apic/>
Aug 26 14:42:58 user nova-compute[73052]:     <vmcoreinfo state='on'/>
Aug 26 14:42:58 user nova-compute[73052]:   </features>
Aug 26 14:42:58 user nova-compute[73052]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 14:42:58 user nova-compute[73052]:     <model fallback='forbid'>Nehalem</model>
Aug 26 14:42:58 user nova-compute[73052]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 14:42:58 user nova-compute[73052]:     <feature policy='require' name='vme'/>
Aug 26 14:42:58 user nova-compute[73052]:     <feature policy='require' name='x2apic'/>
Aug 26 14:42:58 user nova-compute[73052]:     <feature policy='require' name='hypervisor'/>
Aug 26 14:42:58 user nova-compute[73052]:   </cpu>
Aug 26 14:42:58 user nova-compute[73052]:   <clock offset='utc'>
Aug 26 14:42:58 user nova-compute[73052]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 14:42:58 user nova-compute[73052]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 14:42:58 user nova-compute[73052]:     <timer name='hpet' present='no'/>
Aug 26 14:42:58 user nova-compute[73052]:   </clock>
Aug 26 14:42:58 user nova-compute[73052]:   <on_poweroff>destroy</on_poweroff>
Aug 26 14:42:58 user nova-compute[73052]:   <on_reboot>restart</on_reboot>
Aug 26 14:42:58 user nova-compute[73052]:   <on_crash>destroy</on_crash>
Aug 26 14:42:58 user nova-compute[73052]:   <devices>
Aug 26 14:42:58 user nova-compute[73052]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 14:42:58 user nova-compute[73052]:     <disk type='file' device='disk'>
Aug 26 14:42:58 user nova-compute[73052]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 14:42:58 user nova-compute[73052]:       <source file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk' index='2'/>
Aug 26 14:42:58 user nova-compute[73052]:       <backingStore type='file' index='3'>
Aug 26 14:42:58 user nova-compute[73052]:         <format type='raw'/>
Aug 26 14:42:58 user nova-compute[73052]:         <source file='/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a'/>
Aug 26 14:42:58 user nova-compute[73052]:         <backingStore/>
Aug 26 14:42:58 user nova-compute[73052]:       </backingStore>
Aug 26 14:42:58 user nova-compute[73052]:       <target dev='vda' bus='virtio'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='virtio-disk0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </disk>
Aug 26 14:42:58 user nova-compute[73052]:     <disk type='file' device='cdrom'>
Aug 26 14:42:58 user nova-compute[73052]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 14:42:58 user nova-compute[73052]:       <source file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.config' index='1'/>
Aug 26 14:42:58 user nova-compute[73052]:       <backingStore/>
Aug 26 14:42:58 user nova-compute[73052]:       <target dev='hda' bus='ide'/>
Aug 26 14:42:58 user nova-compute[73052]:       <readonly/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='ide0-0-0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </disk>
Aug 26 14:42:58 user nova-compute[73052]:     <controller type='usb' index='0' model='none'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='usb'/>
Aug 26 14:42:58 user nova-compute[73052]:     </controller>
Aug 26 14:42:58 user nova-compute[73052]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='pci.0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </controller>
Aug 26 14:42:58 user nova-compute[73052]:     <controller type='ide' index='0'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='ide'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 14:42:58 user nova-compute[73052]:     </controller>
Aug 26 14:42:58 user nova-compute[73052]:     <interface type='ethernet'>
Aug 26 14:42:58 user nova-compute[73052]:       <mac address='fa:16:3e:6e:74:c4'/>
Aug 26 14:42:58 user nova-compute[73052]:       <target dev='tap64d1aab0-95'/>
Aug 26 14:42:58 user nova-compute[73052]:       <model type='virtio'/>
Aug 26 14:42:58 user nova-compute[73052]:       <mtu size='1442'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='net0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </interface>
Aug 26 14:42:58 user nova-compute[73052]:     <interface type='ethernet'>
Aug 26 14:42:58 user nova-compute[73052]:       <mac address='fa:16:3e:2b:70:90'/>
Aug 26 14:42:58 user nova-compute[73052]:       <target dev='tapa39ad84b-08'/>
Aug 26 14:42:58 user nova-compute[73052]:       <model type='virtio'/>
Aug 26 14:42:58 user nova-compute[73052]:       <mtu size='1442'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='net1'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </interface>
Aug 26 14:42:58 user nova-compute[73052]:     <serial type='pty'>
Aug 26 14:42:58 user nova-compute[73052]:       <source path='/dev/pts/5'/>
Aug 26 14:42:58 user nova-compute[73052]:       <log file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log' append='off'/>
Aug 26 14:42:58 user nova-compute[73052]:       <target type='isa-serial' port='0'>
Aug 26 14:42:58 user nova-compute[73052]:         <model name='isa-serial'/>
Aug 26 14:42:58 user nova-compute[73052]:       </target>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='serial0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </serial>
Aug 26 14:42:58 user nova-compute[73052]:     <console type='pty' tty='/dev/pts/5'>
Aug 26 14:42:58 user nova-compute[73052]:       <source path='/dev/pts/5'/>
Aug 26 14:42:58 user nova-compute[73052]:       <log file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log' append='off'/>
Aug 26 14:42:58 user nova-compute[73052]:       <target type='serial' port='0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='serial0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </console>
Aug 26 14:42:58 user nova-compute[73052]:     <input type='mouse' bus='ps2'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='input0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </input>
Aug 26 14:42:58 user nova-compute[73052]:     <input type='keyboard' bus='ps2'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='input1'/>
Aug 26 14:42:58 user nova-compute[73052]:     </input>
Aug 26 14:42:58 user nova-compute[73052]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 26 14:42:58 user nova-compute[73052]:       <listen type='address' address='0.0.0.0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </graphics>
Aug 26 14:42:58 user nova-compute[73052]:     <audio id='1' type='none'/>
Aug 26 14:42:58 user nova-compute[73052]:     <video>
Aug 26 14:42:58 user nova-compute[73052]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='video0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </video>
Aug 26 14:42:58 user nova-compute[73052]:     <memballoon model='virtio'>
Aug 26 14:42:58 user nova-compute[73052]:       <stats period='10'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='balloon0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </memballoon>
Aug 26 14:42:58 user nova-compute[73052]:     <rng model='virtio'>
Aug 26 14:42:58 user nova-compute[73052]:       <backend model='random'>/dev/urandom</backend>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='rng0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </rng>
Aug 26 14:42:58 user nova-compute[73052]:   </devices>
Aug 26 14:42:58 user nova-compute[73052]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 14:42:58 user nova-compute[73052]:     <label>libvirt-55971d31-4c54-4150-bfbd-4636df306fbd</label>
Aug 26 14:42:58 user nova-compute[73052]:     <imagelabel>libvirt-55971d31-4c54-4150-bfbd-4636df306fbd</imagelabel>
Aug 26 14:42:58 user nova-compute[73052]:   </seclabel>
Aug 26 14:42:58 user nova-compute[73052]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 14:42:58 user nova-compute[73052]:     <label>+64055:+108</label>
Aug 26 14:42:58 user nova-compute[73052]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 14:42:58 user nova-compute[73052]:   </seclabel>
Aug 26 14:42:58 user nova-compute[73052]: </domain>
Aug 26 14:42:58 user nova-compute[73052]:  {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 14:42:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Successfully detached device tapa39ad84b-08 from instance 55971d31-4c54-4150-bfbd-4636df306fbd from the persistent domain config.
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] (1/8): Attempting to detach device tapa39ad84b-08 with device alias net1 from instance 55971d31-4c54-4150-bfbd-4636df306fbd from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] detach device xml: <interface type="ethernet">
Aug 26 14:42:58 user nova-compute[73052]:   <mac address="fa:16:3e:2b:70:90"/>
Aug 26 14:42:58 user nova-compute[73052]:   <model type="virtio"/>
Aug 26 14:42:58 user nova-compute[73052]:   <mtu size="1442"/>
Aug 26 14:42:58 user nova-compute[73052]:   <target dev="tapa39ad84b-08"/>
Aug 26 14:42:58 user nova-compute[73052]: </interface>
Aug 26 14:42:58 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[013b3065-bd07-48ef-a0a3-bb2d012095c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:42:58 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1481bf5-692c-4e52-a43c-764134ee918d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854] added
Aug 26 14:42:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4188272d-d027-46cf-8f4d-898bf32151d7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7b6bb9-b179-4c24-9a98-0310528b3417]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fBnvCYxd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fBnvCYxd" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb854cd-4a08-4a27-9642-79b5ac917193]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fBnvCYxd'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd59ce-aae2-4fc2-988a-db98fc87f220]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3598c78-7baa-40b9-8293-dca70c67a144]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693060978.809434, bb7d8ce2-141a-4ba9-b545-858875307ff0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb7d8ce2-141a-4ba9-b545-858875307ff0 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:42:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Successfully detached device vdb from instance bb7d8ce2-141a-4ba9-b545-858875307ff0 from the live domain config.
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdcf6bc-a81f-415a-9825-3c2054bd7eb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854, portal: 172.16.0.220,3260]
Aug 26 14:42:58 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854, portal: 172.16.0.220,3260] successful.
Aug 26 14:42:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXzVPBYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:42:58 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d09a216-d149-4dda-915c-c0aa62df9bf4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a38c9b-7771-484d-ae2f-90adafcb5184]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:42:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:58 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:42:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693060978.9004989, 55971d31-4c54-4150-bfbd-4636df306fbd => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17c6a1-4bc2-4b22-aac7-a0694f3e57f1]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBnvCYxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Start waiting for the detach event from libvirt for device tapa39ad84b-08 with device alias net1 for instance 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface> {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 26 14:42:58 user nova-compute[73052]:   <name>instance-00000007</name>
Aug 26 14:42:58 user nova-compute[73052]:   <uuid>55971d31-4c54-4150-bfbd-4636df306fbd</uuid>
Aug 26 14:42:58 user nova-compute[73052]:   <metadata>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:42:58 user nova-compute[73052]:   <nova:package version="0.0.0"/>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:name>tempest-device-tagging-server-938538042</nova:name>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:creationTime>2023-08-26 14:42:30</nova:creationTime>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:flavor name="m1.tiny">
Aug 26 14:42:58 user nova-compute[73052]:     <nova:memory>512</nova:memory>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:disk>1</nova:disk>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:swap>0</nova:swap>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:vcpus>1</nova:vcpus>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:flavor>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:owner>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:user uuid="67f2f57480264fc5b15f17f7f94fc1a1">tempest-TaggedAttachmentsTest-395402729-project-member</nova:user>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:project uuid="176dded2fa8441a194f131cbe8a4eefe">tempest-TaggedAttachmentsTest-395402729</nova:project>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:owner>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:ports>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:port uuid="64d1aab0-95f3-4ac4-bb41-cc97c1d5365e">
Aug 26 14:42:58 user nova-compute[73052]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:42:58 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:port uuid="a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a">
Aug 26 14:42:58 user nova-compute[73052]:       <nova:ip type="fixed" address="10.10.10.146" ipVersion="4"/>
Aug 26 14:42:58 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:ports>
Aug 26 14:42:58 user nova-compute[73052]: </nova:instance>
Aug 26 14:42:58 user nova-compute[73052]:   </metadata>
Aug 26 14:42:58 user nova-compute[73052]:   <memory unit='KiB'>524288</memory>
Aug 26 14:42:58 user nova-compute[73052]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 14:42:58 user nova-compute[73052]:   <vcpu placement='static'>1</vcpu>
Aug 26 14:42:58 user nova-compute[73052]:   <resource>
Aug 26 14:42:58 user nova-compute[73052]:     <partition>/machine</partition>
Aug 26 14:42:58 user nova-compute[73052]:   </resource>
Aug 26 14:42:58 user nova-compute[73052]:   <sysinfo type='smbios'>
Aug 26 14:42:58 user nova-compute[73052]:     <system>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='version'>0.0.0</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='serial'>55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='uuid'>55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:42:58 user nova-compute[73052]:       <entry name='family'>Virtual Machine</entry>
Aug 26 14:42:58 user nova-compute[73052]:     </system>
Aug 26 14:42:58 user nova-compute[73052]:   </sysinfo>
Aug 26 14:42:58 user nova-compute[73052]:   <os>
Aug 26 14:42:58 user nova-compute[73052]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 14:42:58 user nova-compute[73052]:     <boot dev='hd'/>
Aug 26 14:42:58 user nova-compute[73052]:     <smbios mode='sysinfo'/>
Aug 26 14:42:58 user nova-compute[73052]:   </os>
Aug 26 14:42:58 user nova-compute[73052]:   <features>
Aug 26 14:42:58 user nova-compute[73052]:     <acpi/>
Aug 26 14:42:58 user nova-compute[73052]:     <apic/>
Aug 26 14:42:58 user nova-compute[73052]:     <vmcoreinfo state='on'/>
Aug 26 14:42:58 user nova-compute[73052]:   </features>
Aug 26 14:42:58 user nova-compute[73052]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 14:42:58 user nova-compute[73052]:     <model fallback='forbid'>Nehalem</model>
Aug 26 14:42:58 user nova-compute[73052]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 14:42:58 user nova-compute[73052]:     <feature policy='require' name='vme'/>
Aug 26 14:42:58 user nova-compute[73052]:     <feature policy='require' name='x2apic'/>
Aug 26 14:42:58 user nova-compute[73052]:     <feature policy='require' name='hypervisor'/>
Aug 26 14:42:58 user nova-compute[73052]:   </cpu>
Aug 26 14:42:58 user nova-compute[73052]:   <clock offset='utc'>
Aug 26 14:42:58 user nova-compute[73052]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 14:42:58 user nova-compute[73052]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 14:42:58 user nova-compute[73052]:     <timer name='hpet' present='no'/>
Aug 26 14:42:58 user nova-compute[73052]:   </clock>
Aug 26 14:42:58 user nova-compute[73052]:   <on_poweroff>destroy</on_poweroff>
Aug 26 14:42:58 user nova-compute[73052]:   <on_reboot>restart</on_reboot>
Aug 26 14:42:58 user nova-compute[73052]:   <on_crash>destroy</on_crash>
Aug 26 14:42:58 user nova-compute[73052]:   <devices>
Aug 26 14:42:58 user nova-compute[73052]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 14:42:58 user nova-compute[73052]:     <disk type='file' device='disk'>
Aug 26 14:42:58 user nova-compute[73052]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 14:42:58 user nova-compute[73052]:       <source file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk' index='2'/>
Aug 26 14:42:58 user nova-compute[73052]:       <backingStore type='file' index='3'>
Aug 26 14:42:58 user nova-compute[73052]:         <format type='raw'/>
Aug 26 14:42:58 user nova-compute[73052]:         <source file='/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a'/>
Aug 26 14:42:58 user nova-compute[73052]:         <backingStore/>
Aug 26 14:42:58 user nova-compute[73052]:       </backingStore>
Aug 26 14:42:58 user nova-compute[73052]:       <target dev='vda' bus='virtio'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='virtio-disk0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </disk>
Aug 26 14:42:58 user nova-compute[73052]:     <disk type='file' device='cdrom'>
Aug 26 14:42:58 user nova-compute[73052]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 14:42:58 user nova-compute[73052]:       <source file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.config' index='1'/>
Aug 26 14:42:58 user nova-compute[73052]:       <backingStore/>
Aug 26 14:42:58 user nova-compute[73052]:       <target dev='hda' bus='ide'/>
Aug 26 14:42:58 user nova-compute[73052]:       <readonly/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='ide0-0-0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </disk>
Aug 26 14:42:58 user nova-compute[73052]:     <controller type='usb' index='0' model='none'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='usb'/>
Aug 26 14:42:58 user nova-compute[73052]:     </controller>
Aug 26 14:42:58 user nova-compute[73052]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='pci.0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </controller>
Aug 26 14:42:58 user nova-compute[73052]:     <controller type='ide' index='0'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='ide'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 14:42:58 user nova-compute[73052]:     </controller>
Aug 26 14:42:58 user nova-compute[73052]:     <interface type='ethernet'>
Aug 26 14:42:58 user nova-compute[73052]:       <mac address='fa:16:3e:6e:74:c4'/>
Aug 26 14:42:58 user nova-compute[73052]:       <target dev='tap64d1aab0-95'/>
Aug 26 14:42:58 user nova-compute[73052]:       <model type='virtio'/>
Aug 26 14:42:58 user nova-compute[73052]:       <mtu size='1442'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='net0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </interface>
Aug 26 14:42:58 user nova-compute[73052]:     <serial type='pty'>
Aug 26 14:42:58 user nova-compute[73052]:       <source path='/dev/pts/5'/>
Aug 26 14:42:58 user nova-compute[73052]:       <log file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log' append='off'/>
Aug 26 14:42:58 user nova-compute[73052]:       <target type='isa-serial' port='0'>
Aug 26 14:42:58 user nova-compute[73052]:         <model name='isa-serial'/>
Aug 26 14:42:58 user nova-compute[73052]:       </target>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='serial0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </serial>
Aug 26 14:42:58 user nova-compute[73052]:     <console type='pty' tty='/dev/pts/5'>
Aug 26 14:42:58 user nova-compute[73052]:       <source path='/dev/pts/5'/>
Aug 26 14:42:58 user nova-compute[73052]:       <log file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log' append='off'/>
Aug 26 14:42:58 user nova-compute[73052]:       <target type='serial' port='0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='serial0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </console>
Aug 26 14:42:58 user nova-compute[73052]:     <input type='mouse' bus='ps2'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='input0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </input>
Aug 26 14:42:58 user nova-compute[73052]:     <input type='keyboard' bus='ps2'>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='input1'/>
Aug 26 14:42:58 user nova-compute[73052]:     </input>
Aug 26 14:42:58 user nova-compute[73052]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 26 14:42:58 user nova-compute[73052]:       <listen type='address' address='0.0.0.0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </graphics>
Aug 26 14:42:58 user nova-compute[73052]:     <audio id='1' type='none'/>
Aug 26 14:42:58 user nova-compute[73052]:     <video>
Aug 26 14:42:58 user nova-compute[73052]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='video0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </video>
Aug 26 14:42:58 user nova-compute[73052]:     <memballoon model='virtio'>
Aug 26 14:42:58 user nova-compute[73052]:       <stats period='10'/>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='balloon0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </memballoon>
Aug 26 14:42:58 user nova-compute[73052]:     <rng model='virtio'>
Aug 26 14:42:58 user nova-compute[73052]:       <backend model='random'>/dev/urandom</backend>
Aug 26 14:42:58 user nova-compute[73052]:       <alias name='rng0'/>
Aug 26 14:42:58 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 14:42:58 user nova-compute[73052]:     </rng>
Aug 26 14:42:58 user nova-compute[73052]:   </devices>
Aug 26 14:42:58 user nova-compute[73052]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 14:42:58 user nova-compute[73052]:     <label>libvirt-55971d31-4c54-4150-bfbd-4636df306fbd</label>
Aug 26 14:42:58 user nova-compute[73052]:     <imagelabel>libvirt-55971d31-4c54-4150-bfbd-4636df306fbd</imagelabel>
Aug 26 14:42:58 user nova-compute[73052]:   </seclabel>
Aug 26 14:42:58 user nova-compute[73052]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 14:42:58 user nova-compute[73052]:     <label>+64055:+108</label>
Aug 26 14:42:58 user nova-compute[73052]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 14:42:58 user nova-compute[73052]:   </seclabel>
Aug 26 14:42:58 user nova-compute[73052]: </domain>
Aug 26 14:42:58 user nova-compute[73052]:  {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 14:42:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Successfully detached device tapa39ad84b-08 from instance 55971d31-4c54-4150-bfbd-4636df306fbd from the live domain config.
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converting VIF {"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG os_vif [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa39ad84b-08, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:58 user nova-compute[73052]: INFO os_vif [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08')
Aug 26 14:42:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:42:58 user nova-compute[73052]:   <nova:package version="0.0.0"/>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:name>tempest-device-tagging-server-938538042</nova:name>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:creationTime>2023-08-26 14:42:58</nova:creationTime>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:flavor name="m1.tiny">
Aug 26 14:42:58 user nova-compute[73052]:     <nova:memory>512</nova:memory>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:disk>1</nova:disk>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:swap>0</nova:swap>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:vcpus>1</nova:vcpus>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:flavor>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:owner>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:user uuid="67f2f57480264fc5b15f17f7f94fc1a1">tempest-TaggedAttachmentsTest-395402729-project-member</nova:user>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:project uuid="176dded2fa8441a194f131cbe8a4eefe">tempest-TaggedAttachmentsTest-395402729</nova:project>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:owner>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:42:58 user nova-compute[73052]:   <nova:ports>
Aug 26 14:42:58 user nova-compute[73052]:     <nova:port uuid="64d1aab0-95f3-4ac4-bb41-cc97c1d5365e">
Aug 26 14:42:58 user nova-compute[73052]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:42:58 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:58 user nova-compute[73052]:   </nova:ports>
Aug 26 14:42:58 user nova-compute[73052]: </nova:instance>
Aug 26 14:42:58 user nova-compute[73052]:  {{(pid=73052) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-ef43539e-21ac-4648-938a-29d3c76eaa42 req-660049e2-10bd-40c0-90b1-8a352c339037 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-unplugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ef43539e-21ac-4648-938a-29d3c76eaa42 req-660049e2-10bd-40c0-90b1-8a352c339037 service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ef43539e-21ac-4648-938a-29d3c76eaa42 req-660049e2-10bd-40c0-90b1-8a352c339037 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ef43539e-21ac-4648-938a-29d3c76eaa42 req-660049e2-10bd-40c0-90b1-8a352c339037 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-ef43539e-21ac-4648-938a-29d3c76eaa42 req-660049e2-10bd-40c0-90b1-8a352c339037 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-unplugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:42:59 user nova-compute[73052]: WARNING nova.compute.manager [req-ef43539e-21ac-4648-938a-29d3c76eaa42 req-660049e2-10bd-40c0-90b1-8a352c339037 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-unplugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a for instance with vm_state active and task_state None.
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquired lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-deleted-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:42:59 user nova-compute[73052]: INFO nova.compute.manager [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Neutron deleted interface a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a; detaching it from the instance and deleting it from the info cache
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.network.neutron [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating instance_info_cache with network_info: [{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.objects.instance [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Lazy-loading 'system_metadata' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.objects.instance [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Lazy-loading 'flavor' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.objects.base [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Object Instance<55971d31-4c54-4150-bfbd-4636df306fbd> lazy-loaded attributes: system_metadata,flavor {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.network.os_vif_util [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Converting VIF {"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.network.os_vif_util [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface> {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 26 14:42:59 user nova-compute[73052]:   <name>instance-00000007</name>
Aug 26 14:42:59 user nova-compute[73052]:   <uuid>55971d31-4c54-4150-bfbd-4636df306fbd</uuid>
Aug 26 14:42:59 user nova-compute[73052]:   <metadata>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:42:59 user nova-compute[73052]:   <nova:package version="0.0.0"/>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:name>tempest-device-tagging-server-938538042</nova:name>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:creationTime>2023-08-26 14:42:58</nova:creationTime>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:flavor name="m1.tiny">
Aug 26 14:42:59 user nova-compute[73052]:     <nova:memory>512</nova:memory>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:disk>1</nova:disk>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:swap>0</nova:swap>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:vcpus>1</nova:vcpus>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:flavor>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:owner>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:user uuid="67f2f57480264fc5b15f17f7f94fc1a1">tempest-TaggedAttachmentsTest-395402729-project-member</nova:user>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:project uuid="176dded2fa8441a194f131cbe8a4eefe">tempest-TaggedAttachmentsTest-395402729</nova:project>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:owner>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:ports>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:port uuid="64d1aab0-95f3-4ac4-bb41-cc97c1d5365e">
Aug 26 14:42:59 user nova-compute[73052]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:42:59 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:ports>
Aug 26 14:42:59 user nova-compute[73052]: </nova:instance>
Aug 26 14:42:59 user nova-compute[73052]:   </metadata>
Aug 26 14:42:59 user nova-compute[73052]:   <memory unit='KiB'>524288</memory>
Aug 26 14:42:59 user nova-compute[73052]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 14:42:59 user nova-compute[73052]:   <vcpu placement='static'>1</vcpu>
Aug 26 14:42:59 user nova-compute[73052]:   <resource>
Aug 26 14:42:59 user nova-compute[73052]:     <partition>/machine</partition>
Aug 26 14:42:59 user nova-compute[73052]:   </resource>
Aug 26 14:42:59 user nova-compute[73052]:   <sysinfo type='smbios'>
Aug 26 14:42:59 user nova-compute[73052]:     <system>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='version'>0.0.0</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='serial'>55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='uuid'>55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='family'>Virtual Machine</entry>
Aug 26 14:42:59 user nova-compute[73052]:     </system>
Aug 26 14:42:59 user nova-compute[73052]:   </sysinfo>
Aug 26 14:42:59 user nova-compute[73052]:   <os>
Aug 26 14:42:59 user nova-compute[73052]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 14:42:59 user nova-compute[73052]:     <boot dev='hd'/>
Aug 26 14:42:59 user nova-compute[73052]:     <smbios mode='sysinfo'/>
Aug 26 14:42:59 user nova-compute[73052]:   </os>
Aug 26 14:42:59 user nova-compute[73052]:   <features>
Aug 26 14:42:59 user nova-compute[73052]:     <acpi/>
Aug 26 14:42:59 user nova-compute[73052]:     <apic/>
Aug 26 14:42:59 user nova-compute[73052]:     <vmcoreinfo state='on'/>
Aug 26 14:42:59 user nova-compute[73052]:   </features>
Aug 26 14:42:59 user nova-compute[73052]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 14:42:59 user nova-compute[73052]:     <model fallback='forbid'>Nehalem</model>
Aug 26 14:42:59 user nova-compute[73052]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 14:42:59 user nova-compute[73052]:     <feature policy='require' name='vme'/>
Aug 26 14:42:59 user nova-compute[73052]:     <feature policy='require' name='x2apic'/>
Aug 26 14:42:59 user nova-compute[73052]:     <feature policy='require' name='hypervisor'/>
Aug 26 14:42:59 user nova-compute[73052]:   </cpu>
Aug 26 14:42:59 user nova-compute[73052]:   <clock offset='utc'>
Aug 26 14:42:59 user nova-compute[73052]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 14:42:59 user nova-compute[73052]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 14:42:59 user nova-compute[73052]:     <timer name='hpet' present='no'/>
Aug 26 14:42:59 user nova-compute[73052]:   </clock>
Aug 26 14:42:59 user nova-compute[73052]:   <on_poweroff>destroy</on_poweroff>
Aug 26 14:42:59 user nova-compute[73052]:   <on_reboot>restart</on_reboot>
Aug 26 14:42:59 user nova-compute[73052]:   <on_crash>destroy</on_crash>
Aug 26 14:42:59 user nova-compute[73052]:   <devices>
Aug 26 14:42:59 user nova-compute[73052]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 14:42:59 user nova-compute[73052]:     <disk type='file' device='disk'>
Aug 26 14:42:59 user nova-compute[73052]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 14:42:59 user nova-compute[73052]:       <source file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk' index='2'/>
Aug 26 14:42:59 user nova-compute[73052]:       <backingStore type='file' index='3'>
Aug 26 14:42:59 user nova-compute[73052]:         <format type='raw'/>
Aug 26 14:42:59 user nova-compute[73052]:         <source file='/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a'/>
Aug 26 14:42:59 user nova-compute[73052]:         <backingStore/>
Aug 26 14:42:59 user nova-compute[73052]:       </backingStore>
Aug 26 14:42:59 user nova-compute[73052]:       <target dev='vda' bus='virtio'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='virtio-disk0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </disk>
Aug 26 14:42:59 user nova-compute[73052]:     <disk type='file' device='cdrom'>
Aug 26 14:42:59 user nova-compute[73052]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 14:42:59 user nova-compute[73052]:       <source file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.config' index='1'/>
Aug 26 14:42:59 user nova-compute[73052]:       <backingStore/>
Aug 26 14:42:59 user nova-compute[73052]:       <target dev='hda' bus='ide'/>
Aug 26 14:42:59 user nova-compute[73052]:       <readonly/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='ide0-0-0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </disk>
Aug 26 14:42:59 user nova-compute[73052]:     <controller type='usb' index='0' model='none'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='usb'/>
Aug 26 14:42:59 user nova-compute[73052]:     </controller>
Aug 26 14:42:59 user nova-compute[73052]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='pci.0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </controller>
Aug 26 14:42:59 user nova-compute[73052]:     <controller type='ide' index='0'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='ide'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 14:42:59 user nova-compute[73052]:     </controller>
Aug 26 14:42:59 user nova-compute[73052]:     <interface type='ethernet'>
Aug 26 14:42:59 user nova-compute[73052]:       <mac address='fa:16:3e:6e:74:c4'/>
Aug 26 14:42:59 user nova-compute[73052]:       <target dev='tap64d1aab0-95'/>
Aug 26 14:42:59 user nova-compute[73052]:       <model type='virtio'/>
Aug 26 14:42:59 user nova-compute[73052]:       <mtu size='1442'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='net0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </interface>
Aug 26 14:42:59 user nova-compute[73052]:     <serial type='pty'>
Aug 26 14:42:59 user nova-compute[73052]:       <source path='/dev/pts/5'/>
Aug 26 14:42:59 user nova-compute[73052]:       <log file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log' append='off'/>
Aug 26 14:42:59 user nova-compute[73052]:       <target type='isa-serial' port='0'>
Aug 26 14:42:59 user nova-compute[73052]:         <model name='isa-serial'/>
Aug 26 14:42:59 user nova-compute[73052]:       </target>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='serial0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </serial>
Aug 26 14:42:59 user nova-compute[73052]:     <console type='pty' tty='/dev/pts/5'>
Aug 26 14:42:59 user nova-compute[73052]:       <source path='/dev/pts/5'/>
Aug 26 14:42:59 user nova-compute[73052]:       <log file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log' append='off'/>
Aug 26 14:42:59 user nova-compute[73052]:       <target type='serial' port='0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='serial0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </console>
Aug 26 14:42:59 user nova-compute[73052]:     <input type='mouse' bus='ps2'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='input0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </input>
Aug 26 14:42:59 user nova-compute[73052]:     <input type='keyboard' bus='ps2'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='input1'/>
Aug 26 14:42:59 user nova-compute[73052]:     </input>
Aug 26 14:42:59 user nova-compute[73052]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 26 14:42:59 user nova-compute[73052]:       <listen type='address' address='0.0.0.0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </graphics>
Aug 26 14:42:59 user nova-compute[73052]:     <audio id='1' type='none'/>
Aug 26 14:42:59 user nova-compute[73052]:     <video>
Aug 26 14:42:59 user nova-compute[73052]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='video0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </video>
Aug 26 14:42:59 user nova-compute[73052]:     <memballoon model='virtio'>
Aug 26 14:42:59 user nova-compute[73052]:       <stats period='10'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='balloon0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </memballoon>
Aug 26 14:42:59 user nova-compute[73052]:     <rng model='virtio'>
Aug 26 14:42:59 user nova-compute[73052]:       <backend model='random'>/dev/urandom</backend>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='rng0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </rng>
Aug 26 14:42:59 user nova-compute[73052]:   </devices>
Aug 26 14:42:59 user nova-compute[73052]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 14:42:59 user nova-compute[73052]:     <label>libvirt-55971d31-4c54-4150-bfbd-4636df306fbd</label>
Aug 26 14:42:59 user nova-compute[73052]:     <imagelabel>libvirt-55971d31-4c54-4150-bfbd-4636df306fbd</imagelabel>
Aug 26 14:42:59 user nova-compute[73052]:   </seclabel>
Aug 26 14:42:59 user nova-compute[73052]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 14:42:59 user nova-compute[73052]:     <label>+64055:+108</label>
Aug 26 14:42:59 user nova-compute[73052]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 14:42:59 user nova-compute[73052]:   </seclabel>
Aug 26 14:42:59 user nova-compute[73052]: </domain>
Aug 26 14:42:59 user nova-compute[73052]:  {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface> {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2b:70:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapa39ad84b-08"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 26 14:42:59 user nova-compute[73052]:   <name>instance-00000007</name>
Aug 26 14:42:59 user nova-compute[73052]:   <uuid>55971d31-4c54-4150-bfbd-4636df306fbd</uuid>
Aug 26 14:42:59 user nova-compute[73052]:   <metadata>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:42:59 user nova-compute[73052]:   <nova:package version="0.0.0"/>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:name>tempest-device-tagging-server-938538042</nova:name>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:creationTime>2023-08-26 14:42:58</nova:creationTime>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:flavor name="m1.tiny">
Aug 26 14:42:59 user nova-compute[73052]:     <nova:memory>512</nova:memory>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:disk>1</nova:disk>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:swap>0</nova:swap>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:vcpus>1</nova:vcpus>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:flavor>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:owner>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:user uuid="67f2f57480264fc5b15f17f7f94fc1a1">tempest-TaggedAttachmentsTest-395402729-project-member</nova:user>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:project uuid="176dded2fa8441a194f131cbe8a4eefe">tempest-TaggedAttachmentsTest-395402729</nova:project>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:owner>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:ports>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:port uuid="64d1aab0-95f3-4ac4-bb41-cc97c1d5365e">
Aug 26 14:42:59 user nova-compute[73052]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:42:59 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:ports>
Aug 26 14:42:59 user nova-compute[73052]: </nova:instance>
Aug 26 14:42:59 user nova-compute[73052]:   </metadata>
Aug 26 14:42:59 user nova-compute[73052]:   <memory unit='KiB'>524288</memory>
Aug 26 14:42:59 user nova-compute[73052]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 14:42:59 user nova-compute[73052]:   <vcpu placement='static'>1</vcpu>
Aug 26 14:42:59 user nova-compute[73052]:   <resource>
Aug 26 14:42:59 user nova-compute[73052]:     <partition>/machine</partition>
Aug 26 14:42:59 user nova-compute[73052]:   </resource>
Aug 26 14:42:59 user nova-compute[73052]:   <sysinfo type='smbios'>
Aug 26 14:42:59 user nova-compute[73052]:     <system>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='version'>0.0.0</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='serial'>55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='uuid'>55971d31-4c54-4150-bfbd-4636df306fbd</entry>
Aug 26 14:42:59 user nova-compute[73052]:       <entry name='family'>Virtual Machine</entry>
Aug 26 14:42:59 user nova-compute[73052]:     </system>
Aug 26 14:42:59 user nova-compute[73052]:   </sysinfo>
Aug 26 14:42:59 user nova-compute[73052]:   <os>
Aug 26 14:42:59 user nova-compute[73052]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 14:42:59 user nova-compute[73052]:     <boot dev='hd'/>
Aug 26 14:42:59 user nova-compute[73052]:     <smbios mode='sysinfo'/>
Aug 26 14:42:59 user nova-compute[73052]:   </os>
Aug 26 14:42:59 user nova-compute[73052]:   <features>
Aug 26 14:42:59 user nova-compute[73052]:     <acpi/>
Aug 26 14:42:59 user nova-compute[73052]:     <apic/>
Aug 26 14:42:59 user nova-compute[73052]:     <vmcoreinfo state='on'/>
Aug 26 14:42:59 user nova-compute[73052]:   </features>
Aug 26 14:42:59 user nova-compute[73052]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 14:42:59 user nova-compute[73052]:     <model fallback='forbid'>Nehalem</model>
Aug 26 14:42:59 user nova-compute[73052]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 14:42:59 user nova-compute[73052]:     <feature policy='require' name='vme'/>
Aug 26 14:42:59 user nova-compute[73052]:     <feature policy='require' name='x2apic'/>
Aug 26 14:42:59 user nova-compute[73052]:     <feature policy='require' name='hypervisor'/>
Aug 26 14:42:59 user nova-compute[73052]:   </cpu>
Aug 26 14:42:59 user nova-compute[73052]:   <clock offset='utc'>
Aug 26 14:42:59 user nova-compute[73052]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 14:42:59 user nova-compute[73052]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 14:42:59 user nova-compute[73052]:     <timer name='hpet' present='no'/>
Aug 26 14:42:59 user nova-compute[73052]:   </clock>
Aug 26 14:42:59 user nova-compute[73052]:   <on_poweroff>destroy</on_poweroff>
Aug 26 14:42:59 user nova-compute[73052]:   <on_reboot>restart</on_reboot>
Aug 26 14:42:59 user nova-compute[73052]:   <on_crash>destroy</on_crash>
Aug 26 14:42:59 user nova-compute[73052]:   <devices>
Aug 26 14:42:59 user nova-compute[73052]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 14:42:59 user nova-compute[73052]:     <disk type='file' device='disk'>
Aug 26 14:42:59 user nova-compute[73052]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 14:42:59 user nova-compute[73052]:       <source file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk' index='2'/>
Aug 26 14:42:59 user nova-compute[73052]:       <backingStore type='file' index='3'>
Aug 26 14:42:59 user nova-compute[73052]:         <format type='raw'/>
Aug 26 14:42:59 user nova-compute[73052]:         <source file='/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a'/>
Aug 26 14:42:59 user nova-compute[73052]:         <backingStore/>
Aug 26 14:42:59 user nova-compute[73052]:       </backingStore>
Aug 26 14:42:59 user nova-compute[73052]:       <target dev='vda' bus='virtio'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='virtio-disk0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </disk>
Aug 26 14:42:59 user nova-compute[73052]:     <disk type='file' device='cdrom'>
Aug 26 14:42:59 user nova-compute[73052]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 14:42:59 user nova-compute[73052]:       <source file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk.config' index='1'/>
Aug 26 14:42:59 user nova-compute[73052]:       <backingStore/>
Aug 26 14:42:59 user nova-compute[73052]:       <target dev='hda' bus='ide'/>
Aug 26 14:42:59 user nova-compute[73052]:       <readonly/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='ide0-0-0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </disk>
Aug 26 14:42:59 user nova-compute[73052]:     <controller type='usb' index='0' model='none'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='usb'/>
Aug 26 14:42:59 user nova-compute[73052]:     </controller>
Aug 26 14:42:59 user nova-compute[73052]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='pci.0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </controller>
Aug 26 14:42:59 user nova-compute[73052]:     <controller type='ide' index='0'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='ide'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 14:42:59 user nova-compute[73052]:     </controller>
Aug 26 14:42:59 user nova-compute[73052]:     <interface type='ethernet'>
Aug 26 14:42:59 user nova-compute[73052]:       <mac address='fa:16:3e:6e:74:c4'/>
Aug 26 14:42:59 user nova-compute[73052]:       <target dev='tap64d1aab0-95'/>
Aug 26 14:42:59 user nova-compute[73052]:       <model type='virtio'/>
Aug 26 14:42:59 user nova-compute[73052]:       <mtu size='1442'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='net0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </interface>
Aug 26 14:42:59 user nova-compute[73052]:     <serial type='pty'>
Aug 26 14:42:59 user nova-compute[73052]:       <source path='/dev/pts/5'/>
Aug 26 14:42:59 user nova-compute[73052]:       <log file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log' append='off'/>
Aug 26 14:42:59 user nova-compute[73052]:       <target type='isa-serial' port='0'>
Aug 26 14:42:59 user nova-compute[73052]:         <model name='isa-serial'/>
Aug 26 14:42:59 user nova-compute[73052]:       </target>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='serial0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </serial>
Aug 26 14:42:59 user nova-compute[73052]:     <console type='pty' tty='/dev/pts/5'>
Aug 26 14:42:59 user nova-compute[73052]:       <source path='/dev/pts/5'/>
Aug 26 14:42:59 user nova-compute[73052]:       <log file='/opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/console.log' append='off'/>
Aug 26 14:42:59 user nova-compute[73052]:       <target type='serial' port='0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='serial0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </console>
Aug 26 14:42:59 user nova-compute[73052]:     <input type='mouse' bus='ps2'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='input0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </input>
Aug 26 14:42:59 user nova-compute[73052]:     <input type='keyboard' bus='ps2'>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='input1'/>
Aug 26 14:42:59 user nova-compute[73052]:     </input>
Aug 26 14:42:59 user nova-compute[73052]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 26 14:42:59 user nova-compute[73052]:       <listen type='address' address='0.0.0.0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </graphics>
Aug 26 14:42:59 user nova-compute[73052]:     <audio id='1' type='none'/>
Aug 26 14:42:59 user nova-compute[73052]:     <video>
Aug 26 14:42:59 user nova-compute[73052]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='video0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </video>
Aug 26 14:42:59 user nova-compute[73052]:     <memballoon model='virtio'>
Aug 26 14:42:59 user nova-compute[73052]:       <stats period='10'/>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='balloon0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </memballoon>
Aug 26 14:42:59 user nova-compute[73052]:     <rng model='virtio'>
Aug 26 14:42:59 user nova-compute[73052]:       <backend model='random'>/dev/urandom</backend>
Aug 26 14:42:59 user nova-compute[73052]:       <alias name='rng0'/>
Aug 26 14:42:59 user nova-compute[73052]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 14:42:59 user nova-compute[73052]:     </rng>
Aug 26 14:42:59 user nova-compute[73052]:   </devices>
Aug 26 14:42:59 user nova-compute[73052]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 14:42:59 user nova-compute[73052]:     <label>libvirt-55971d31-4c54-4150-bfbd-4636df306fbd</label>
Aug 26 14:42:59 user nova-compute[73052]:     <imagelabel>libvirt-55971d31-4c54-4150-bfbd-4636df306fbd</imagelabel>
Aug 26 14:42:59 user nova-compute[73052]:   </seclabel>
Aug 26 14:42:59 user nova-compute[73052]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 14:42:59 user nova-compute[73052]:     <label>+64055:+108</label>
Aug 26 14:42:59 user nova-compute[73052]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 14:42:59 user nova-compute[73052]:   </seclabel>
Aug 26 14:42:59 user nova-compute[73052]: </domain>
Aug 26 14:42:59 user nova-compute[73052]:  {{(pid=73052) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 14:42:59 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Detaching interface fa:16:3e:2b:70:90 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa39ad84b-08' not found.
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.network.os_vif_util [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Converting VIF {"id": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "address": "fa:16:3e:2b:70:90", "network": {"id": "2dbeb862-6c9b-4328-9070-83920a0ec4f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-57502945", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39ad84b-08", "ovs_interfaceid": "a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.network.os_vif_util [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_vif [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa39ad84b-08, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:42:59 user nova-compute[73052]: INFO os_vif [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:90,bridge_name='br-int',has_traffic_filtering=True,id=a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a,network=Network(2dbeb862-6c9b-4328-9070-83920a0ec4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39ad84b-08')
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [req-09152477-4256-4d2c-85e3-18dcf5a8a4ca req-4a6d3c77-91f8-40b0-8517-6387d061698c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:42:59 user nova-compute[73052]:   <nova:package version="0.0.0"/>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:name>tempest-device-tagging-server-938538042</nova:name>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:creationTime>2023-08-26 14:42:59</nova:creationTime>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:flavor name="m1.tiny">
Aug 26 14:42:59 user nova-compute[73052]:     <nova:memory>512</nova:memory>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:disk>1</nova:disk>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:swap>0</nova:swap>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:vcpus>1</nova:vcpus>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:flavor>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:owner>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:user uuid="67f2f57480264fc5b15f17f7f94fc1a1">tempest-TaggedAttachmentsTest-395402729-project-member</nova:user>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:project uuid="176dded2fa8441a194f131cbe8a4eefe">tempest-TaggedAttachmentsTest-395402729</nova:project>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:owner>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:42:59 user nova-compute[73052]:   <nova:ports>
Aug 26 14:42:59 user nova-compute[73052]:     <nova:port uuid="64d1aab0-95f3-4ac4-bb41-cc97c1d5365e">
Aug 26 14:42:59 user nova-compute[73052]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:42:59 user nova-compute[73052]:     </nova:port>
Aug 26 14:42:59 user nova-compute[73052]:   </nova:ports>
Aug 26 14:42:59 user nova-compute[73052]: </nova:instance>
Aug 26 14:42:59 user nova-compute[73052]:  {{(pid=73052) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26638313963366637', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638313963366637', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.093s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG nova.objects.instance [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lazy-loading 'flavor' on Instance uuid fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8414f-9bfb-4f76-be7f-10a01e5d2f93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbe74e7-7031-4994-883a-f288bc179d67]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:59 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:59 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:59 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:42:59 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:42:59 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:42:59 user nova-compute[73052]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 (non-flash)
Aug 26 14:42:59 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:42:59 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a017dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8'): ({'sdf'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Removing single pathed devices sdf {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c23abb8-2745-4c9a-b533-87689cb2193a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:42:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8594a665-0323-423b-a72b-d598bd8490df]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Flushing IO for device /dev/sdf {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b7c5a3-3c98-49ed-ad16-9fbc3956b06c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:43:00 user nova-compute[73052]: INFO nova.network.neutron [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Port a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 26 14:43:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating instance_info_cache with network_info: [{"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Releasing lock "refresh_cache-55971d31-4c54-4150-bfbd-4636df306fbd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d762f45-195c-4b6f-b1ae-9fcfc5deec31 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "interface-55971d31-4c54-4150-bfbd-4636df306fbd-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.578s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[383247ce-953e-4fb2-8311-2710fcc55aa8]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] SCSI volumes sdf have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b43e60e-0dd2-4687-9953-fe67cd179860]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[866107d7-9970-4cd4-b849-98ca94565157]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8, portal: 172.16.0.220,3260]
Aug 26 14:43:00 user nova-compute[73052]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8, portal: 172.16.0.220,3260] successful.
Aug 26 14:43:00 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298d3550-fb12-4754-bec1-b557fe19e4f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[764fdc0d-7f37-44c7-bd17-35b8592ec827]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] <== disconnect_volume: return (1401ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 120586240 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-9da37035-a2d6-4d73-9d95-076694e1fa51 req-f186c3a8-af44-4f62-9aee-3be31d258f0f service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9da37035-a2d6-4d73-9d95-076694e1fa51 req-f186c3a8-af44-4f62-9aee-3be31d258f0f service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9da37035-a2d6-4d73-9d95-076694e1fa51 req-f186c3a8-af44-4f62-9aee-3be31d258f0f service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9da37035-a2d6-4d73-9d95-076694e1fa51 req-f186c3a8-af44-4f62-9aee-3be31d258f0f service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-9da37035-a2d6-4d73-9d95-076694e1fa51 req-f186c3a8-af44-4f62-9aee-3be31d258f0f service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:01 user nova-compute[73052]: WARNING nova.compute.manager [req-9da37035-a2d6-4d73-9d95-076694e1fa51 req-f186c3a8-af44-4f62-9aee-3be31d258f0f service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-a39ad84b-08ff-4f8e-8900-f8c3cda4bb1a for instance with vm_state active and task_state None.
Aug 26 14:43:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:01 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lazy-loading 'flavor' on Instance uuid bb7d8ce2-141a-4ba9-b545-858875307ff0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:43:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a90b02a2-f2ee-43c1-b88f-e4452679053b tempest-VolumesAssistedSnapshotsTest-1032421919 tempest-VolumesAssistedSnapshotsTest-1032421919-project-admin] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.324s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 423624704 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:02 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693060967.1531808, af3029db-dce7-4f4e-b907-630ac9ff72d0 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:43:02 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] VM Stopped (Lifecycle Event)
Aug 26 14:43:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-70e4d2af-4d88-426b-b0d0-73ef763faae4 None None] [instance: af3029db-dce7-4f4e-b907-630ac9ff72d0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:43:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 738197504 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 893386752 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 1027604480 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:04 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d242ba-7fe3-48fc-93b0-f7a5095601b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b800848-0abd-43c7-bf85-b032323399db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:43:04 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:04 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:43:04 user nova-compute[73052]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:04 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0796ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa57c544-a703-41e7-b7c5-a7dc8a4de15b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d84268-119a-4e07-b58b-01133bbddc03]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[486bf0ca-736d-4330-9477-f4572641095a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5881c21a-0ade-4402-bab3-e938ef46e291]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[966d2367-18f5-4575-9af4-2f73da6e6160]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd0089f-c5ad-4e3e-af01-c0052dcff3da]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260]
Aug 26 14:43:04 user nova-compute[73052]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260] successful.
Aug 26 14:43:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c569a54f-fc9c-483a-8618-a09e448a48f7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] <== disconnect_volume: return (303ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBnvCYxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fc07b8f2-3c64-4de9-a0a4-55121f6a90c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd6fbe75-df86-4283-a5ac-7c28f9e66854', 'serial'} {{(pid=73052) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 14:43:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] swap_volume: removing Cinder connection for volume 792f8fb0-989e-4137-9720-28dcffc84b8f {{(pid=73052) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 14:43:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] swap_volume: Updating volume 792f8fb0-989e-4137-9720-28dcffc84b8f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "fBnvCYxd", "auth_password": "5qLdhBSP6jtERO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "cd6fbe75-df86-4283-a5ac-7c28f9e66854"}, "status": "reserved", "instance": "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9", "attached_at": "", "detached_at": "", "volume_id": "cd6fbe75-df86-4283-a5ac-7c28f9e66854", "serial": "cd6fbe75-df86-4283-a5ac-7c28f9e66854"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'cd6fbe75-df86-4283-a5ac-7c28f9e66854', 'no_device': None, 'attachment_id': 'db982173-1286-43e5-821c-a2854e85320a'} {{(pid=73052) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 14:43:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eef3b03a-e5cd-4b12-ba59-7ed2f42f7af0 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.369s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG os_brick.utils [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b7f4c-844b-45b2-89c7-fb6cc412d960]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd8f2e-2eac-421b-82b2-dcaeb3203a31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb10f47c-3607-4a1d-ae51-561ce0727ba2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802b2a0-11af-482c-b892-b296b4f50792]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:43:06 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:43:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[07da9aea-626c-49c1-9321-8057128d0a41]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:43:06 user nova-compute[73052]: DEBUG os_brick.utils [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:06 user nova-compute[73052]: INFO nova.compute.manager [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Swapping volume cd6fbe75-df86-4283-a5ac-7c28f9e66854 for 792f8fb0-989e-4137-9720-28dcffc84b8f
Aug 26 14:43:07 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updating instance_info_cache with network_info: [{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:11 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:43:11 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7145MB free_disk=25.496196746826172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 79922a3f-53e3-4d29-8000-902e986e30c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance acb26430-b816-4969-b379-720e98cf59e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 55971d31-4c54-4150-bfbd-4636df306fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance bb7d8ce2-141a-4ba9-b545-858875307ff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 335b65f2-0096-41fe-9ad2-71335afdd454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f0a01be4-94ff-4f2e-930f-a1e90b79abee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 779434fd-eaf2-48c1-8a96-1fcb6532fb32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:43:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:43:12 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:43:12 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:43:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:43:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-131d1074-af7e-4483-8a97-c3c963baaaea req-685b351e-9df5-4f44-9d8e-915ba4e73da7 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-changed-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-131d1074-af7e-4483-8a97-c3c963baaaea req-685b351e-9df5-4f44-9d8e-915ba4e73da7 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Refreshing instance network info cache due to event network-changed-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-131d1074-af7e-4483-8a97-c3c963baaaea req-685b351e-9df5-4f44-9d8e-915ba4e73da7 service nova] Acquiring lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-131d1074-af7e-4483-8a97-c3c963baaaea req-685b351e-9df5-4f44-9d8e-915ba4e73da7 service nova] Acquired lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-131d1074-af7e-4483-8a97-c3c963baaaea req-685b351e-9df5-4f44-9d8e-915ba4e73da7 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Refreshing network info cache for port 37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc07b8f2-3c64-4de9-a0a4-55121f6a90c9', 'attached_at': '', 'detached_at': '', 'volume_id': '792f8fb0-989e-4137-9720-28dcffc84b8f', 'serial': '792f8fb0-989e-4137-9720-28dcffc84b8f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBnvCYxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'cd6fbe75-df86-4283-a5ac-7c28f9e66854'}, 'status': 'reserved', 'instance': 'fc07b8f2-3c64-4de9-a0a4-55121f6a90c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd6fbe75-df86-4283-a5ac-7c28f9e66854', 'serial'} {{(pid=73052) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:21 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:43:21 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:43:21 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[61510484-86db-459c-96de-35e8ceeb874f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:43:21 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6408ac-e25e-4221-ad83-696269f67cf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f] added
Aug 26 14:43:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[211304c5-5b0a-4290-beab-5d2c179a6fdb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7f881c-ccd0-4c8d-b299-3ef3364af0a8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqEicdsV {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqEicdsV" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf5c0f4-35c0-423d-b13e-6dc52ee95b71]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LqEicdsV'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[040aa26a-f105-4da3-a73a-a51979528086]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f391f-7155-4203-b97d-ba41646074e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:43:21 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:43:21 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5262afa2-d829-485b-9851-9690deabd99f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260]
Aug 26 14:43:21 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260] successful.
Aug 26 14:43:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[740ebc77-fdcf-4714-a97f-190aa2b1a1b3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a737d8e7-0639-4b87-8924-6783644a4dbf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:43:21 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:21 user nova-compute[73052]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:43:21 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:21 user nova-compute[73052]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] HCTL ('35', '-', '-', 0) found on session 9 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b754fa0d-6838-4323-a765-a7053eb3300d]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-131d1074-af7e-4483-8a97-c3c963baaaea req-685b351e-9df5-4f44-9d8e-915ba4e73da7 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Updated VIF entry in instance network info cache for port 37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-131d1074-af7e-4483-8a97-c3c963baaaea req-685b351e-9df5-4f44-9d8e-915ba4e73da7 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Updating instance_info_cache with network_info: [{"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-131d1074-af7e-4483-8a97-c3c963baaaea req-685b351e-9df5-4f44-9d8e-915ba4e73da7 service nova] Releasing lock "refresh_cache-f0a01be4-94ff-4f2e-930f-a1e90b79abee" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:43:22 user nova-compute[73052]: INFO nova.compute.manager [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Rebuilding instance
Aug 26 14:43:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26366316439313739', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366316439313739', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lazy-loading 'flavor' on Instance uuid fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-unplugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] No waiting events found dispatching network-vif-unplugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:23 user nova-compute[73052]: WARNING nova.compute.manager [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received unexpected event network-vif-unplugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 for instance with vm_state active and task_state rebuilding.
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] No waiting events found dispatching network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:23 user nova-compute[73052]: WARNING nova.compute.manager [req-561d7014-6bdf-4019-a8b4-13409c201a4c req-c03e1932-ae65-48e1-a37a-9379cb568cb4 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received unexpected event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 for instance with vm_state active and task_state rebuilding.
Aug 26 14:43:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance destroyed successfully.
Aug 26 14:43:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance destroyed successfully.
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1882452549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1009623059',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfBT9UGn/x6RhdSNVThc9709tWxKHd6uEPnsmjrMDl00UJ5WNxNYiqynxvWwjc21UlKvegnvwH1hbCsy0UqTdMc3LUYbgvkFLENhpgsRbhQCqJRHoVO3Cf5KM4QrR4hQ==',key_name='tempest-keypair-165596234',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:41:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23b4d9738fee4f0d8670371434d086e7',ramdisk_id='',reservation_id='r-nd0jgg04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-122650918',owner_user_name='tempest-ServerActionsV293TestJSON-122650918-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:43:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe3f4a562b249adb11042d070008e2c',uuid=f0a01be4-94ff-4f2e-930f-a1e90b79abee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converting VIF {"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_vif [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37b4ca8a-8f, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:23 user nova-compute[73052]: INFO os_vif [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f')
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:23 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bef391-68f8-499c-bd25-022cbb34e408]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1828a06-a1a7-411b-a8ad-40d485b320f8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:43:23 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:23 user nova-compute[73052]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:43:23 user nova-compute[73052]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:23 user nova-compute[73052]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0172710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 150994944 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[571d40c2-0b2d-417c-acc6-cb1173aa9ac6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.038s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f61cc3-435f-41c0-ab38-8ba2cc4c4ec4]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d1e09-4f9f-470f-b2bd-2b4a38db8931]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fecde7a-9364-4f71-b328-9bfffc7173ef]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_32ac093c', '/dev/disk/by-id/scsi-1SCST_BIO32ac093c-f7d5a991380f72c5', '/dev/disk/by-id/scsi-26637643561393931') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc671335-d186-4f3b-87fc-8e067f1fe2d9]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c57b5b-e716-46d2-957b-6f49cbc64cc8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8a00f0-eb26-41c9-9a0d-4cbe5432ee47]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260]
Aug 26 14:43:24 user nova-compute[73052]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260] successful.
Aug 26 14:43:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e9754-fe18-4990-902b-02f70b063a2d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] <== disconnect_volume: return (386ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:43:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Deleting instance files /opt/stack/data/nova/instances/f0a01be4-94ff-4f2e-930f-a1e90b79abee_del
Aug 26 14:43:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Deletion of /opt/stack/data/nova/instances/f0a01be4-94ff-4f2e-930f-a1e90b79abee_del complete
Aug 26 14:43:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 292552704 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:24 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f0a01be4-94ff-4f2e-930f-a1e90b79abee could not be found.
Aug 26 14:43:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:24 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9de9f47-34db-4ea1-b81c-d00ac209c1e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7ef612-55d8-4637-8f94-a3980226b6c3]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:24 user nova-compute[73052]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:24 user nova-compute[73052]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813d1b0>, {}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Disconnecting from: [] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] <== disconnect_volume: return (71ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:43:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 472907776 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 726663168 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Preparing to wait for external event volume-reimaged-c3ef495a-6902-45c5-a8b6-195f586cb84e {{(pid=73052) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 14:43:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 842006528 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 989855744 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBnvCYxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'cd6fbe75-df86-4283-a5ac-7c28f9e66854'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:27 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1dd0e4-f44a-4830-bc26-9b25beb774a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c5d884-d9e3-458a-b7fc-a2191a26370f]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:27 user nova-compute[73052]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 (non-flash)
Aug 26 14:43:27 user nova-compute[73052]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0185ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f964a563-0a3a-4a19-a779-db50d3044b95]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c58efa-fc8f-4099-8db9-ed45f35038f3]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb780d4c-1234-47e9-aec8-1270fd1eb93e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edce131-daa4-4f54-9222-7c6f6b06aa70]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b099af-2470-4db3-a626-ab814b301461]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1143963b-0a08-40e5-8529-75af70345e21]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854, portal: 172.16.0.220,3260]
Aug 26 14:43:27 user nova-compute[73052]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854, portal: 172.16.0.220,3260] successful.
Aug 26 14:43:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6fbe75-df86-4283-a5ac-7c28f9e66854 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c85fec-7935-4b1a-a608-a56f3c732db4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] <== disconnect_volume: return (266ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fc07b8f2-3c64-4de9-a0a4-55121f6a90c9', 'attached_at': '', 'detached_at': '', 'volume_id': '792f8fb0-989e-4137-9720-28dcffc84b8f', 'serial'} {{(pid=73052) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 14:43:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] swap_volume: removing Cinder connection for volume cd6fbe75-df86-4283-a5ac-7c28f9e66854 {{(pid=73052) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 14:43:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] swap_volume: Updating volume cd6fbe75-df86-4283-a5ac-7c28f9e66854 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "LqEicdsV", "auth_password": "C7iG19aUkIWL2u", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "792f8fb0-989e-4137-9720-28dcffc84b8f"}, "status": "reserved", "instance": "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9", "attached_at": "", "detached_at": "", "volume_id": "792f8fb0-989e-4137-9720-28dcffc84b8f", "serial": "792f8fb0-989e-4137-9720-28dcffc84b8f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '792f8fb0-989e-4137-9720-28dcffc84b8f', 'no_device': None, 'attachment_id': '92468ed8-b6f5-4086-a59e-4ade8c409f64'} {{(pid=73052) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 14:43:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac183c99-32f7-484c-ada2-7e3e562c0026 tempest-TestVolumeSwap-587147715 tempest-TestVolumeSwap-587147715-project-admin] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.030s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:29 user nova-compute[73052]: INFO nova.compute.manager [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Detaching volume 792f8fb0-989e-4137-9720-28dcffc84b8f
Aug 26 14:43:29 user nova-compute[73052]: INFO nova.virt.block_device [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Attempting to driver detach volume 792f8fb0-989e-4137-9720-28dcffc84b8f from mountpoint /dev/vdb
Aug 26 14:43:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Attempting to detach device vdb from instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:43:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:43:29 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:43:29 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:43:29 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:43:29 user nova-compute[73052]:   <serial>792f8fb0-989e-4137-9720-28dcffc84b8f</serial>
Aug 26 14:43:29 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:43:29 user nova-compute[73052]: </disk>
Aug 26 14:43:29 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:43:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Successfully detached device vdb from instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 from the persistent domain config.
Aug 26 14:43:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:43:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:43:29 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:43:29 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:43:29 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:43:29 user nova-compute[73052]:   <serial>792f8fb0-989e-4137-9720-28dcffc84b8f</serial>
Aug 26 14:43:29 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:43:29 user nova-compute[73052]: </disk>
Aug 26 14:43:29 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061010.4580808, fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:43:30 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Successfully detached device vdb from instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 from the live domain config.
Aug 26 14:43:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqEicdsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '792f8fb0-989e-4137-9720-28dcffc84b8f'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:30 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9254e945-68bb-424a-aed8-1690181841c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ea031a-6307-4f85-9c76-394f29a3351a]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:30 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f (non-flash)
Aug 26 14:43:30 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0797640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eaed32-44b0-47b5-83f8-f3ca7129c347]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7190251-a279-4dc9-8f00-8f89dda49e71]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0a6d02-9970-4a5d-8255-98971f489184]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[341de427-344d-4ec5-ba7f-f21bc55c07e5]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95f75c1-6713-46e5-a841-ea110b5b5331]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0f37d0-5efc-44ed-981e-f7ae7620711d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260]
Aug 26 14:43:30 user nova-compute[73052]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f, portal: 172.16.0.220,3260] successful.
Aug 26 14:43:30 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f8fb0-989e-4137-9720-28dcffc84b8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b658f-6520-45be-bdbf-025bb5d366f9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] <== disconnect_volume: return (256ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "335b65f2-0096-41fe-9ad2-71335afdd454" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "335b65f2-0096-41fe-9ad2-71335afdd454" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:31 user nova-compute[73052]: INFO nova.compute.manager [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Terminating instance
Aug 26 14:43:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lazy-loading 'flavor' on Instance uuid fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e47744b-17ee-4c17-9553-5ad43c2596b7 tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.035s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-de2cd762-0591-47ef-b1c6-7afde6c3da28 req-c79aa97d-de1d-408d-8da6-093d8ac2cfa5 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received event network-vif-unplugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de2cd762-0591-47ef-b1c6-7afde6c3da28 req-c79aa97d-de1d-408d-8da6-093d8ac2cfa5 service nova] Acquiring lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de2cd762-0591-47ef-b1c6-7afde6c3da28 req-c79aa97d-de1d-408d-8da6-093d8ac2cfa5 service nova] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de2cd762-0591-47ef-b1c6-7afde6c3da28 req-c79aa97d-de1d-408d-8da6-093d8ac2cfa5 service nova] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-de2cd762-0591-47ef-b1c6-7afde6c3da28 req-c79aa97d-de1d-408d-8da6-093d8ac2cfa5 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] No waiting events found dispatching network-vif-unplugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-de2cd762-0591-47ef-b1c6-7afde6c3da28 req-c79aa97d-de1d-408d-8da6-093d8ac2cfa5 service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received event network-vif-unplugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:43:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Instance destroyed successfully.
Aug 26 14:43:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lazy-loading 'resources' on Instance uuid 335b65f2-0096-41fe-9ad2-71335afdd454 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1956061972',display_name='tempest-VolumesActionsTest-instance-1956061972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1956061972',id=10,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:41:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30376a3f4f524f83b95f4e1f52383c3d',ramdisk_id='',reservation_id='r-4373fbf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1060392860',owner_user_name='tempest-VolumesActionsTest-1060392860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:41:33Z,user_data=None,user_id='6d8522ef503248a9b04ea8b55564c506',uuid=335b65f2-0096-41fe-9ad2-71335afdd454,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Converting VIF {"id": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "address": "fa:16:3e:e2:22:1b", "network": {"id": "14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2091568416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30376a3f4f524f83b95f4e1f52383c3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db1cf5d-33", "ovs_interfaceid": "4db1cf5d-33f0-488a-bf04-3cc2e9507294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:22:1b,bridge_name='br-int',has_traffic_filtering=True,id=4db1cf5d-33f0-488a-bf04-3cc2e9507294,network=Network(14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db1cf5d-33') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG os_vif [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:22:1b,bridge_name='br-int',has_traffic_filtering=True,id=4db1cf5d-33f0-488a-bf04-3cc2e9507294,network=Network(14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db1cf5d-33') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4db1cf5d-33, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:43:32 user nova-compute[73052]: INFO os_vif [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:22:1b,bridge_name='br-int',has_traffic_filtering=True,id=4db1cf5d-33f0-488a-bf04-3cc2e9507294,network=Network(14e52c5a-cfaa-4417-9d1c-2f4758eb0e1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db1cf5d-33')
Aug 26 14:43:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Deleting instance files /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454_del
Aug 26 14:43:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Deletion of /opt/stack/data/nova/instances/335b65f2-0096-41fe-9ad2-71335afdd454_del complete
Aug 26 14:43:32 user nova-compute[73052]: INFO nova.compute.manager [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 14:43:32 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:43:32 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:32 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Took 0.55 seconds to deallocate network for instance.
Aug 26 14:43:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-a93a2a66-0953-4246-aea0-d95c49ea0fcd req-2dc320f3-0127-41dd-ae40-ee46b71aacbd service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received event network-vif-deleted-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:33 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:43:33 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:43:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:33 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Deleted allocations for instance 335b65f2-0096-41fe-9ad2-71335afdd454
Aug 26 14:43:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-202b1f1d-c985-4dd8-bd2a-19c09c9bb3f1 tempest-VolumesActionsTest-1060392860 tempest-VolumesActionsTest-1060392860-project-member] Lock "335b65f2-0096-41fe-9ad2-71335afdd454" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-946309dc-4fa2-403b-a7bc-341656ef2d91 req-4b16491e-57b3-44c6-9aab-b34862b1806f service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received event network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-946309dc-4fa2-403b-a7bc-341656ef2d91 req-4b16491e-57b3-44c6-9aab-b34862b1806f service nova] Acquiring lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-946309dc-4fa2-403b-a7bc-341656ef2d91 req-4b16491e-57b3-44c6-9aab-b34862b1806f service nova] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-946309dc-4fa2-403b-a7bc-341656ef2d91 req-4b16491e-57b3-44c6-9aab-b34862b1806f service nova] Lock "335b65f2-0096-41fe-9ad2-71335afdd454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-946309dc-4fa2-403b-a7bc-341656ef2d91 req-4b16491e-57b3-44c6-9aab-b34862b1806f service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] No waiting events found dispatching network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:34 user nova-compute[73052]: WARNING nova.compute.manager [req-946309dc-4fa2-403b-a7bc-341656ef2d91 req-4b16491e-57b3-44c6-9aab-b34862b1806f service nova] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Received unexpected event network-vif-plugged-4db1cf5d-33f0-488a-bf04-3cc2e9507294 for instance with vm_state deleted and task_state None.
Aug 26 14:43:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:38 user nova-compute[73052]: INFO nova.compute.manager [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Terminating instance
Aug 26 14:43:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061003.691666, f0a01be4-94ff-4f2e-930f-a1e90b79abee => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:43:38 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] VM Stopped (Lifecycle Event)
Aug 26 14:43:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4c681149-d4d5-415a-b07c-0784cb91f1cf None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-38a13615-3e1a-497e-b86c-396f3224d4eb req-6727a018-0850-43b7-a816-57a44fd9f24b service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received event network-vif-unplugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38a13615-3e1a-497e-b86c-396f3224d4eb req-6727a018-0850-43b7-a816-57a44fd9f24b service nova] Acquiring lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38a13615-3e1a-497e-b86c-396f3224d4eb req-6727a018-0850-43b7-a816-57a44fd9f24b service nova] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38a13615-3e1a-497e-b86c-396f3224d4eb req-6727a018-0850-43b7-a816-57a44fd9f24b service nova] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-38a13615-3e1a-497e-b86c-396f3224d4eb req-6727a018-0850-43b7-a816-57a44fd9f24b service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] No waiting events found dispatching network-vif-unplugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-38a13615-3e1a-497e-b86c-396f3224d4eb req-6727a018-0850-43b7-a816-57a44fd9f24b service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received event network-vif-unplugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Instance destroyed successfully.
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.objects.instance [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lazy-loading 'resources' on Instance uuid 779434fd-eaf2-48c1-8a96-1fcb6532fb32 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1415822880',display_name='tempest-ServersNegativeTestJSON-server-1415822880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1415822880',id=12,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bbaaf64cd44c06b2c1ef28d17c28cb',ramdisk_id='',reservation_id='r-28naw8je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-618175231',owner_user_name='tempest-ServersNegativeTestJSON-618175231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:41:55Z,user_data=None,user_id='321c53c447cb491585e8eb540b0f4157',uuid=779434fd-eaf2-48c1-8a96-1fcb6532fb32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converting VIF {"id": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "address": "fa:16:3e:61:48:2a", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8d3bc-02", "ovs_interfaceid": "90a8d3bc-0229-4a80-bb56-db69f34bc9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:2a,bridge_name='br-int',has_traffic_filtering=True,id=90a8d3bc-0229-4a80-bb56-db69f34bc9ff,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8d3bc-02') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG os_vif [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:2a,bridge_name='br-int',has_traffic_filtering=True,id=90a8d3bc-0229-4a80-bb56-db69f34bc9ff,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8d3bc-02') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90a8d3bc-02, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:43:39 user nova-compute[73052]: INFO os_vif [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:2a,bridge_name='br-int',has_traffic_filtering=True,id=90a8d3bc-0229-4a80-bb56-db69f34bc9ff,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8d3bc-02')
Aug 26 14:43:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Deleting instance files /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32_del
Aug 26 14:43:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Deletion of /opt/stack/data/nova/instances/779434fd-eaf2-48c1-8a96-1fcb6532fb32_del complete
Aug 26 14:43:39 user nova-compute[73052]: INFO nova.compute.manager [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 26 14:43:39 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:39 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Took 0.50 seconds to deallocate network for instance.
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-a0487898-3c95-4f32-9270-5654f837fb6d req-5f02fdad-5e2a-4382-bddd-8d1362c5cb29 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received event network-vif-deleted-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:39 user nova-compute[73052]: INFO nova.compute.manager [req-a0487898-3c95-4f32-9270-5654f837fb6d req-5f02fdad-5e2a-4382-bddd-8d1362c5cb29 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Neutron deleted interface 90a8d3bc-0229-4a80-bb56-db69f34bc9ff; detaching it from the instance and deleting it from the info cache
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-a0487898-3c95-4f32-9270-5654f837fb6d req-5f02fdad-5e2a-4382-bddd-8d1362c5cb29 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-a0487898-3c95-4f32-9270-5654f837fb6d req-5f02fdad-5e2a-4382-bddd-8d1362c5cb29 service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Detach interface failed, port_id=90a8d3bc-0229-4a80-bb56-db69f34bc9ff, reason: Instance 779434fd-eaf2-48c1-8a96-1fcb6532fb32 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:40 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:43:40 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:43:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:40 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Deleted allocations for instance 779434fd-eaf2-48c1-8a96-1fcb6532fb32
Aug 26 14:43:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-192a48fa-49d8-439b-a645-60c64a0297fe tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.751s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-4b439056-8278-4bdf-9997-68f80b8850d9 req-97c70b07-4df8-4793-9b7c-164e3b6a188d service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received event network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4b439056-8278-4bdf-9997-68f80b8850d9 req-97c70b07-4df8-4793-9b7c-164e3b6a188d service nova] Acquiring lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4b439056-8278-4bdf-9997-68f80b8850d9 req-97c70b07-4df8-4793-9b7c-164e3b6a188d service nova] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4b439056-8278-4bdf-9997-68f80b8850d9 req-97c70b07-4df8-4793-9b7c-164e3b6a188d service nova] Lock "779434fd-eaf2-48c1-8a96-1fcb6532fb32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-4b439056-8278-4bdf-9997-68f80b8850d9 req-97c70b07-4df8-4793-9b7c-164e3b6a188d service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] No waiting events found dispatching network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:40 user nova-compute[73052]: WARNING nova.compute.manager [req-4b439056-8278-4bdf-9997-68f80b8850d9 req-97c70b07-4df8-4793-9b7c-164e3b6a188d service nova] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Received unexpected event network-vif-plugged-90a8d3bc-0229-4a80-bb56-db69f34bc9ff for instance with vm_state deleted and task_state None.
Aug 26 14:43:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "a0f34b07-88ee-4031-be68-73b57e1d2338" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:43:45 user nova-compute[73052]: INFO nova.compute.claims [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Claim successful on node user
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:43:45 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:43:45 user nova-compute[73052]: DEBUG nova.policy [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b571c97da94649df99b6b7c930b4b372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6da93fd12c047348044fdc3eebd776d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:43:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Creating image(s)
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "/opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "/opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk 1073741824" returned: 0 in 0.050s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Cannot resize image /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Ensure instance console log exists: /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Successfully created port: 3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061012.2865684, 335b65f2-0096-41fe-9ad2-71335afdd454 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:43:47 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] VM Stopped (Lifecycle Event)
Aug 26 14:43:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8733ac0b-e6ed-4c54-b34b-bd5a3b5a711b None None] [instance: 335b65f2-0096-41fe-9ad2-71335afdd454] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 req-c10c232f-484d-4bd7-8f30-2570506892ea service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event volume-reimaged-c3ef495a-6902-45c5-a8b6-195f586cb84e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 req-c10c232f-484d-4bd7-8f30-2570506892ea service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 req-c10c232f-484d-4bd7-8f30-2570506892ea service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 req-c10c232f-484d-4bd7-8f30-2570506892ea service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 req-c10c232f-484d-4bd7-8f30-2570506892ea service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Processing event volume-reimaged-c3ef495a-6902-45c5-a8b6-195f586cb84e {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:43:47 user nova-compute[73052]: INFO nova.virt.block_device [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Booting with volume c3ef495a-6902-45c5-a8b6-195f586cb84e at /dev/vda
Aug 26 14:43:47 user nova-compute[73052]: DEBUG os_brick.utils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e3e57-b1a6-4e51-a7b6-7a8b3a63a63e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39d2f61-b9b8-4938-9b18-19f88232d071]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f221bf-becb-4fbc-b227-4a5cc88f8601]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752b54e-a355-4ce3-9260-a3b89a6b555e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:43:48 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e623ab-40a7-4d6d-935d-b92634769d1d]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG os_brick.utils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Updating existing volume attachment record: fdf771e5-70e6-45d4-b4da-99475164134e {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Successfully updated port: 3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "refresh_cache-a0f34b07-88ee-4031-be68-73b57e1d2338" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquired lock "refresh_cache-a0f34b07-88ee-4031-be68-73b57e1d2338" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-ec186f57-8590-47b3-85d9-3b72a7aa4ba0 req-9e87656b-d037-4dde-9bc4-dae3990a1432 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Received event network-changed-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-ec186f57-8590-47b3-85d9-3b72a7aa4ba0 req-9e87656b-d037-4dde-9bc4-dae3990a1432 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Refreshing instance network info cache due to event network-changed-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ec186f57-8590-47b3-85d9-3b72a7aa4ba0 req-9e87656b-d037-4dde-9bc4-dae3990a1432 service nova] Acquiring lock "refresh_cache-a0f34b07-88ee-4031-be68-73b57e1d2338" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.neutron [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Updating instance_info_cache with network_info: [{"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Releasing lock "refresh_cache-a0f34b07-88ee-4031-be68-73b57e1d2338" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Instance network_info: |[{"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ec186f57-8590-47b3-85d9-3b72a7aa4ba0 req-9e87656b-d037-4dde-9bc4-dae3990a1432 service nova] Acquired lock "refresh_cache-a0f34b07-88ee-4031-be68-73b57e1d2338" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.neutron [req-ec186f57-8590-47b3-85d9-3b72a7aa4ba0 req-9e87656b-d037-4dde-9bc4-dae3990a1432 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Refreshing network info cache for port 3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Start _get_guest_xml network_info=[{"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:43:48 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:43:48 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1079271075',display_name='tempest-VolumesAdminNegativeTest-server-1079271075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1079271075',id=13,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6da93fd12c047348044fdc3eebd776d',ramdisk_id='',reservation_id='r-37a0tk47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1985528216',owner_user_name='tempest-VolumesAdminNegativeTest-1985528216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:43:46Z,user_data=None,user_id='b571c97da94649df99b6b7c930b4b372',uuid=a0f34b07-88ee-4031-be68-73b57e1d2338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converting VIF {"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=3910f566-565e-4f52-a3b9-0ecb6eb9ffbd,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f566-56') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lazy-loading 'pci_devices' on Instance uuid a0f34b07-88ee-4031-be68-73b57e1d2338 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:43:48 user nova-compute[73052]:   <uuid>a0f34b07-88ee-4031-be68-73b57e1d2338</uuid>
Aug 26 14:43:48 user nova-compute[73052]:   <name>instance-0000000d</name>
Aug 26 14:43:48 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:43:48 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:43:48 user nova-compute[73052]:   <metadata>
Aug 26 14:43:48 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:43:48 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:43:48 user nova-compute[73052]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1079271075</nova:name>
Aug 26 14:43:48 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:43:48</nova:creationTime>
Aug 26 14:43:48 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:43:48 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:43:48 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:43:48 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:43:48 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:43:48 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:43:48 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:43:48 user nova-compute[73052]:       <nova:owner>
Aug 26 14:43:48 user nova-compute[73052]:         <nova:user uuid="b571c97da94649df99b6b7c930b4b372">tempest-VolumesAdminNegativeTest-1985528216-project-member</nova:user>
Aug 26 14:43:48 user nova-compute[73052]:         <nova:project uuid="e6da93fd12c047348044fdc3eebd776d">tempest-VolumesAdminNegativeTest-1985528216</nova:project>
Aug 26 14:43:48 user nova-compute[73052]:       </nova:owner>
Aug 26 14:43:48 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:43:48 user nova-compute[73052]:       <nova:ports>
Aug 26 14:43:48 user nova-compute[73052]:         <nova:port uuid="3910f566-565e-4f52-a3b9-0ecb6eb9ffbd">
Aug 26 14:43:48 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 14:43:48 user nova-compute[73052]:         </nova:port>
Aug 26 14:43:48 user nova-compute[73052]:       </nova:ports>
Aug 26 14:43:48 user nova-compute[73052]:     </nova:instance>
Aug 26 14:43:48 user nova-compute[73052]:   </metadata>
Aug 26 14:43:48 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:43:48 user nova-compute[73052]:     <system>
Aug 26 14:43:48 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:43:48 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:43:48 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:43:48 user nova-compute[73052]:       <entry name="serial">a0f34b07-88ee-4031-be68-73b57e1d2338</entry>
Aug 26 14:43:48 user nova-compute[73052]:       <entry name="uuid">a0f34b07-88ee-4031-be68-73b57e1d2338</entry>
Aug 26 14:43:48 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:43:48 user nova-compute[73052]:     </system>
Aug 26 14:43:48 user nova-compute[73052]:   </sysinfo>
Aug 26 14:43:48 user nova-compute[73052]:   <os>
Aug 26 14:43:48 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:43:48 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:43:48 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:43:48 user nova-compute[73052]:   </os>
Aug 26 14:43:48 user nova-compute[73052]:   <features>
Aug 26 14:43:48 user nova-compute[73052]:     <acpi/>
Aug 26 14:43:48 user nova-compute[73052]:     <apic/>
Aug 26 14:43:48 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:43:48 user nova-compute[73052]:   </features>
Aug 26 14:43:48 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:43:48 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:43:48 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:43:48 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:43:48 user nova-compute[73052]:   </clock>
Aug 26 14:43:48 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:43:48 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:43:48 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:43:48 user nova-compute[73052]:   </cpu>
Aug 26 14:43:48 user nova-compute[73052]:   <devices>
Aug 26 14:43:48 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:43:48 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:43:48 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk"/>
Aug 26 14:43:48 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:43:48 user nova-compute[73052]:     </disk>
Aug 26 14:43:48 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:43:48 user nova-compute[73052]:       <mac address="fa:16:3e:bb:a3:2f"/>
Aug 26 14:43:48 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:43:48 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:43:48 user nova-compute[73052]:       <target dev="tap3910f566-56"/>
Aug 26 14:43:48 user nova-compute[73052]:     </interface>
Aug 26 14:43:48 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:43:48 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/console.log" append="off"/>
Aug 26 14:43:48 user nova-compute[73052]:     </serial>
Aug 26 14:43:48 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:43:48 user nova-compute[73052]:     <video>
Aug 26 14:43:48 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:43:48 user nova-compute[73052]:     </video>
Aug 26 14:43:48 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:43:48 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:43:48 user nova-compute[73052]:     </rng>
Aug 26 14:43:48 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:43:48 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:43:48 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:43:48 user nova-compute[73052]:     </memballoon>
Aug 26 14:43:48 user nova-compute[73052]:   </devices>
Aug 26 14:43:48 user nova-compute[73052]: </domain>
Aug 26 14:43:48 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1079271075',display_name='tempest-VolumesAdminNegativeTest-server-1079271075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1079271075',id=13,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6da93fd12c047348044fdc3eebd776d',ramdisk_id='',reservation_id='r-37a0tk47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1985528216',owner_user_name='tempest-VolumesAdminNegativeTest-1985528216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:43:46Z,user_data=None,user_id='b571c97da94649df99b6b7c930b4b372',uuid=a0f34b07-88ee-4031-be68-73b57e1d2338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converting VIF {"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=3910f566-565e-4f52-a3b9-0ecb6eb9ffbd,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f566-56') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG os_vif [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=3910f566-565e-4f52-a3b9-0ecb6eb9ffbd,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f566-56') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3910f566-56, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3910f566-56, col_values=(('external_ids', {'iface-id': '3910f566-565e-4f52-a3b9-0ecb6eb9ffbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:a3:2f', 'vm-uuid': 'a0f34b07-88ee-4031-be68-73b57e1d2338'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:48 user nova-compute[73052]: INFO os_vif [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=3910f566-565e-4f52-a3b9-0ecb6eb9ffbd,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f566-56')
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:43:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] No VIF found with MAC fa:16:3e:bb:a3:2f, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG nova.network.neutron [req-ec186f57-8590-47b3-85d9-3b72a7aa4ba0 req-9e87656b-d037-4dde-9bc4-dae3990a1432 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Updated VIF entry in instance network info cache for port 3910f566-565e-4f52-a3b9-0ecb6eb9ffbd. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG nova.network.neutron [req-ec186f57-8590-47b3-85d9-3b72a7aa4ba0 req-9e87656b-d037-4dde-9bc4-dae3990a1432 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Updating instance_info_cache with network_info: [{"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ec186f57-8590-47b3-85d9-3b72a7aa4ba0 req-9e87656b-d037-4dde-9bc4-dae3990a1432 service nova] Releasing lock "refresh_cache-a0f34b07-88ee-4031-be68-73b57e1d2338" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:49 user nova-compute[73052]: INFO nova.compute.manager [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Terminating instance
Aug 26 14:43:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-32cfb5d5-53b1-452c-a0af-a9e1a9aee93c req-2b8e9cdd-735b-4be1-953b-6905855363e7 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-unplugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32cfb5d5-53b1-452c-a0af-a9e1a9aee93c req-2b8e9cdd-735b-4be1-953b-6905855363e7 service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32cfb5d5-53b1-452c-a0af-a9e1a9aee93c req-2b8e9cdd-735b-4be1-953b-6905855363e7 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32cfb5d5-53b1-452c-a0af-a9e1a9aee93c req-2b8e9cdd-735b-4be1-953b-6905855363e7 service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-32cfb5d5-53b1-452c-a0af-a9e1a9aee93c req-2b8e9cdd-735b-4be1-953b-6905855363e7 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-unplugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-32cfb5d5-53b1-452c-a0af-a9e1a9aee93c req-2b8e9cdd-735b-4be1-953b-6905855363e7 service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-unplugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-f70333fd-65a9-413d-81ca-6836e25a8f40 req-d0806732-ee99-46f5-b6a0-baf720a11ebe service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Received event network-vif-plugged-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f70333fd-65a9-413d-81ca-6836e25a8f40 req-d0806732-ee99-46f5-b6a0-baf720a11ebe service nova] Acquiring lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f70333fd-65a9-413d-81ca-6836e25a8f40 req-d0806732-ee99-46f5-b6a0-baf720a11ebe service nova] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f70333fd-65a9-413d-81ca-6836e25a8f40 req-d0806732-ee99-46f5-b6a0-baf720a11ebe service nova] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-f70333fd-65a9-413d-81ca-6836e25a8f40 req-d0806732-ee99-46f5-b6a0-baf720a11ebe service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] No waiting events found dispatching network-vif-plugged-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:50 user nova-compute[73052]: WARNING nova.compute.manager [req-f70333fd-65a9-413d-81ca-6836e25a8f40 req-d0806732-ee99-46f5-b6a0-baf720a11ebe service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Received unexpected event network-vif-plugged-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd for instance with vm_state building and task_state spawning.
Aug 26 14:43:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:51 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Instance destroyed successfully.
Aug 26 14:43:51 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lazy-loading 'resources' on Instance uuid 55971d31-4c54-4150-bfbd-4636df306fbd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938538042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-938538042',id=7,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCe+YHiioiEuHPwxKWNPb9rlzdqpRSsltH9JOL1Mzivb5rwodQ1aba1aI6C9uSr3RSChfrNeC/f6MKF6I0O5TE7ax5Lwt0RVuVhRJjXWxWnH0ms2gBeOzSRww7cFIRTQ==',key_name='tempest-keypair-1608772881',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='176dded2fa8441a194f131cbe8a4eefe',ramdisk_id='',reservation_id='r-tk0yb6jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-395402729',owner_user_name='tempest-TaggedAttachmentsTest-395402729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f2f57480264fc5b15f17f7f94fc1a1',uuid=55971d31-4c54-4150-bfbd-4636df306fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converting VIF {"id": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "address": "fa:16:3e:6e:74:c4", "network": {"id": "b054fa94-66bc-4835-9750-5f8b12b5a621", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-172872181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "176dded2fa8441a194f131cbe8a4eefe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1aab0-95", "ovs_interfaceid": "64d1aab0-95f3-4ac4-bb41-cc97c1d5365e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:74:c4,bridge_name='br-int',has_traffic_filtering=True,id=64d1aab0-95f3-4ac4-bb41-cc97c1d5365e,network=Network(b054fa94-66bc-4835-9750-5f8b12b5a621),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1aab0-95') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG os_vif [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:74:c4,bridge_name='br-int',has_traffic_filtering=True,id=64d1aab0-95f3-4ac4-bb41-cc97c1d5365e,network=Network(b054fa94-66bc-4835-9750-5f8b12b5a621),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1aab0-95') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64d1aab0-95, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:43:51 user nova-compute[73052]: INFO os_vif [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:74:c4,bridge_name='br-int',has_traffic_filtering=True,id=64d1aab0-95f3-4ac4-bb41-cc97c1d5365e,network=Network(b054fa94-66bc-4835-9750-5f8b12b5a621),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1aab0-95')
Aug 26 14:43:51 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Deleting instance files /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd_del
Aug 26 14:43:51 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Deletion of /opt/stack/data/nova/instances/55971d31-4c54-4150-bfbd-4636df306fbd_del complete
Aug 26 14:43:51 user nova-compute[73052]: INFO nova.compute.manager [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Took 1.75 seconds to destroy the instance on the hypervisor.
Aug 26 14:43:51 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:52 user nova-compute[73052]: WARNING nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e for instance with vm_state active and task_state deleting.
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:52 user nova-compute[73052]: WARNING nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e for instance with vm_state active and task_state deleting.
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:52 user nova-compute[73052]: WARNING nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e for instance with vm_state active and task_state deleting.
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-unplugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-unplugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-18f59ce8-a525-4994-b761-45e6d28dc7f1 req-f9c38621-1684-4e64-9a07-57cde458d39b service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-unplugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-de0ded5a-5e9e-4178-a015-0ec0f8d2d980 req-97bf9888-8e8c-42ad-86c9-ee3594a8fa79 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Received event network-vif-plugged-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de0ded5a-5e9e-4178-a015-0ec0f8d2d980 req-97bf9888-8e8c-42ad-86c9-ee3594a8fa79 service nova] Acquiring lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de0ded5a-5e9e-4178-a015-0ec0f8d2d980 req-97bf9888-8e8c-42ad-86c9-ee3594a8fa79 service nova] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de0ded5a-5e9e-4178-a015-0ec0f8d2d980 req-97bf9888-8e8c-42ad-86c9-ee3594a8fa79 service nova] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-de0ded5a-5e9e-4178-a015-0ec0f8d2d980 req-97bf9888-8e8c-42ad-86c9-ee3594a8fa79 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] No waiting events found dispatching network-vif-plugged-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:52 user nova-compute[73052]: WARNING nova.compute.manager [req-de0ded5a-5e9e-4178-a015-0ec0f8d2d980 req-97bf9888-8e8c-42ad-86c9-ee3594a8fa79 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Received unexpected event network-vif-plugged-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd for instance with vm_state building and task_state spawning.
Aug 26 14:43:52 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:52 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Took 1.72 seconds to deallocate network for instance.
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061033.1647122, a0f34b07-88ee-4031-be68-73b57e1d2338 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:43:53 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] VM Resumed (Lifecycle Event)
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:43:53 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Instance spawned successfully.
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:43:53 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061033.1667771, a0f34b07-88ee-4031-be68-73b57e1d2338 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:43:53 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] VM Started (Lifecycle Event)
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:43:53 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:43:53 user nova-compute[73052]: INFO nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Took 7.22 seconds to spawn the instance on the hypervisor.
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:43:53 user nova-compute[73052]: INFO nova.compute.manager [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Took 8.13 seconds to build instance.
Aug 26 14:43:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f3f2334c-16f6-4095-9c74-d867640250e3 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.241s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:53 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Deleted allocations for instance 55971d31-4c54-4150-bfbd-4636df306fbd
Aug 26 14:43:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ee454a2c-d20f-4cd6-8095-a9df2ceaef56 tempest-TaggedAttachmentsTest-395402729 tempest-TaggedAttachmentsTest-395402729-project-member] Lock "55971d31-4c54-4150-bfbd-4636df306fbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.205s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:54 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061019.178104, 779434fd-eaf2-48c1-8a96-1fcb6532fb32 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:43:54 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] VM Stopped (Lifecycle Event)
Aug 26 14:43:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0e3237c2-8981-4775-91e8-8835555c7dc6 None None] [instance: 779434fd-eaf2-48c1-8a96-1fcb6532fb32] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:43:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-24c68054-34d7-427a-8f61-f53774296d96 req-c71a4d7f-41c0-4dc3-b77b-539673381f8a service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24c68054-34d7-427a-8f61-f53774296d96 req-c71a4d7f-41c0-4dc3-b77b-539673381f8a service nova] Acquiring lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24c68054-34d7-427a-8f61-f53774296d96 req-c71a4d7f-41c0-4dc3-b77b-539673381f8a service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24c68054-34d7-427a-8f61-f53774296d96 req-c71a4d7f-41c0-4dc3-b77b-539673381f8a service nova] Lock "55971d31-4c54-4150-bfbd-4636df306fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-24c68054-34d7-427a-8f61-f53774296d96 req-c71a4d7f-41c0-4dc3-b77b-539673381f8a service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] No waiting events found dispatching network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:54 user nova-compute[73052]: WARNING nova.compute.manager [req-24c68054-34d7-427a-8f61-f53774296d96 req-c71a4d7f-41c0-4dc3-b77b-539673381f8a service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received unexpected event network-vif-plugged-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e for instance with vm_state deleted and task_state None.
Aug 26 14:43:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-24c68054-34d7-427a-8f61-f53774296d96 req-c71a4d7f-41c0-4dc3-b77b-539673381f8a service nova] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Received event network-vif-deleted-64d1aab0-95f3-4ac4-bb41-cc97c1d5365e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:56 user nova-compute[73052]: INFO nova.compute.manager [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Terminating instance
Aug 26 14:43:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-a4fc403d-5ec1-458f-befa-f988c63fca26 req-5cf66582-dd34-481a-9da8-027353b68032 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received event network-vif-unplugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a4fc403d-5ec1-458f-befa-f988c63fca26 req-5cf66582-dd34-481a-9da8-027353b68032 service nova] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a4fc403d-5ec1-458f-befa-f988c63fca26 req-5cf66582-dd34-481a-9da8-027353b68032 service nova] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a4fc403d-5ec1-458f-befa-f988c63fca26 req-5cf66582-dd34-481a-9da8-027353b68032 service nova] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-a4fc403d-5ec1-458f-befa-f988c63fca26 req-5cf66582-dd34-481a-9da8-027353b68032 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] No waiting events found dispatching network-vif-unplugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-a4fc403d-5ec1-458f-befa-f988c63fca26 req-5cf66582-dd34-481a-9da8-027353b68032 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received event network-vif-unplugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Instance destroyed successfully.
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lazy-loading 'resources' on Instance uuid bb7d8ce2-141a-4ba9-b545-858875307ff0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1009564263',display_name='tempest-VolumesAssistedSnapshotsTest-server-1009564263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1009564263',id=9,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzFESbEyzBaE81J56bAqNPRL0+9qw9zG1T7JDgJZyYSiTAfINOL8+ST57VFSz03odZdfawp1lEudJqPOyZUNFLetiExzta2iyPGwKUtZ6H61vp0yBnEWB39fNzkBeruvg==',key_name='tempest-keypair-158567399',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92ef29871498426e9f410dcea7a3b947',ramdisk_id='',reservation_id='r-n2dd77ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1188834628',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1188834628-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a90176398446d1ba20ecd6d45eb057',uuid=bb7d8ce2-141a-4ba9-b545-858875307ff0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Converting VIF {"id": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "address": "fa:16:3e:22:6b:02", "network": {"id": "dfe0e2b6-32dd-4801-bca4-ddd8944e9474", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1788902106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ef29871498426e9f410dcea7a3b947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ba2e98-54", "ovs_interfaceid": "91ba2e98-54ab-4357-b08d-edaf5bf4cfd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:6b:02,bridge_name='br-int',has_traffic_filtering=True,id=91ba2e98-54ab-4357-b08d-edaf5bf4cfd6,network=Network(dfe0e2b6-32dd-4801-bca4-ddd8944e9474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ba2e98-54') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG os_vif [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:6b:02,bridge_name='br-int',has_traffic_filtering=True,id=91ba2e98-54ab-4357-b08d-edaf5bf4cfd6,network=Network(dfe0e2b6-32dd-4801-bca4-ddd8944e9474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ba2e98-54') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91ba2e98-54, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:43:57 user nova-compute[73052]: INFO os_vif [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:6b:02,bridge_name='br-int',has_traffic_filtering=True,id=91ba2e98-54ab-4357-b08d-edaf5bf4cfd6,network=Network(dfe0e2b6-32dd-4801-bca4-ddd8944e9474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ba2e98-54')
Aug 26 14:43:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Deleting instance files /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0_del
Aug 26 14:43:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Deletion of /opt/stack/data/nova/instances/bb7d8ce2-141a-4ba9-b545-858875307ff0_del complete
Aug 26 14:43:57 user nova-compute[73052]: INFO nova.compute.manager [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 26 14:43:57 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:43:57 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:43:58 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-0fb777cb-496f-4d4f-aad3-2e4559f0d547 req-ffe289aa-bf1c-4cd6-8dc8-8c681bd4d7b1 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received event network-vif-deleted-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:58 user nova-compute[73052]: INFO nova.compute.manager [req-0fb777cb-496f-4d4f-aad3-2e4559f0d547 req-ffe289aa-bf1c-4cd6-8dc8-8c681bd4d7b1 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Neutron deleted interface 91ba2e98-54ab-4357-b08d-edaf5bf4cfd6; detaching it from the instance and deleting it from the info cache
Aug 26 14:43:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-0fb777cb-496f-4d4f-aad3-2e4559f0d547 req-ffe289aa-bf1c-4cd6-8dc8-8c681bd4d7b1 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:43:58 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Took 1.36 seconds to deallocate network for instance.
Aug 26 14:43:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-0fb777cb-496f-4d4f-aad3-2e4559f0d547 req-ffe289aa-bf1c-4cd6-8dc8-8c681bd4d7b1 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Detach interface failed, port_id=91ba2e98-54ab-4357-b08d-edaf5bf4cfd6, reason: Instance bb7d8ce2-141a-4ba9-b545-858875307ff0 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:43:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:59 user nova-compute[73052]: INFO nova.compute.manager [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Unshelving
Aug 26 14:43:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-9b33d212-522b-48f1-b7da-5aa8e70c4709 req-dd57a497-c8e1-446d-8a84-e119aee44791 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received event network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b33d212-522b-48f1-b7da-5aa8e70c4709 req-dd57a497-c8e1-446d-8a84-e119aee44791 service nova] Acquiring lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b33d212-522b-48f1-b7da-5aa8e70c4709 req-dd57a497-c8e1-446d-8a84-e119aee44791 service nova] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b33d212-522b-48f1-b7da-5aa8e70c4709 req-dd57a497-c8e1-446d-8a84-e119aee44791 service nova] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-9b33d212-522b-48f1-b7da-5aa8e70c4709 req-dd57a497-c8e1-446d-8a84-e119aee44791 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] No waiting events found dispatching network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:43:59 user nova-compute[73052]: WARNING nova.compute.manager [req-9b33d212-522b-48f1-b7da-5aa8e70c4709 req-dd57a497-c8e1-446d-8a84-e119aee44791 service nova] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Received unexpected event network-vif-plugged-91ba2e98-54ab-4357-b08d-edaf5bf4cfd6 for instance with vm_state deleted and task_state None.
Aug 26 14:43:59 user nova-compute[73052]: INFO nova.virt.block_device [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Booting with volume 747d94fe-075a-427a-8a29-ff09feba9875 at /dev/vdc
Aug 26 14:43:59 user nova-compute[73052]: DEBUG os_brick.utils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed09a8-7ced-4b62-9ad3-dfb8fae0015f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e81fd-6406-46c1-b29e-caefdd18ebac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e88f4a4-9ab1-4add-bfad-6b9a38360845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e908d-b5b6-49ae-a140-2cf439fad56f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:43:59 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee9db61-d8e0-49ce-8b9e-ec940d7d2328]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG os_brick.utils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:43:59 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating existing volume attachment record: 04176ae3-7d1f-46df-9660-dffd0d10e6d1 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:43:59 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Deleted allocations for instance bb7d8ce2-141a-4ba9-b545-858875307ff0
Aug 26 14:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d594131a-fb51-4918-9627-aa6d9a6be066 tempest-VolumesAssistedSnapshotsTest-1188834628 tempest-VolumesAssistedSnapshotsTest-1188834628-project-member] Lock "bb7d8ce2-141a-4ba9-b545-858875307ff0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.324s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:44:01 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Creating image(s)
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Ensure instance console log exists: /opt/stack/data/nova/instances/f0a01be4-94ff-4f2e-930f-a1e90b79abee/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Start _get_guest_xml network_info=[{"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'fdf771e5-70e6-45d4-b4da-99475164134e', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0a01be4-94ff-4f2e-930f-a1e90b79abee', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3ef495a-6902-45c5-a8b6-195f586cb84e', 'serial': 'c3ef495a-6902-45c5-a8b6-195f586cb84e'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:44:01 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 14:44:01 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lazy-loading 'vcpu_model' on Instance uuid f0a01be4-94ff-4f2e-930f-a1e90b79abee {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:44:01 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:44:01 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:44:01 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5e35a-07da-4abc-8092-433e4731e87c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:44:01 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86369b0-36b4-47a6-8675-7e297df61b45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e] added
Aug 26 14:44:01 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0ef6d9-675b-4367-9885-08a95234cf73]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1783072-6460-4cef-b942-9641f31b15eb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPtdKJSQ {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPtdKJSQ" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3acffb0-9325-4326-add6-fddbec9bcdde]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aPtdKJSQ'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94bc5b1-921d-4b50-97d0-a68f93d131ed]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58bb3db-d455-4968-8626-0ba45d58e256]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:44:01 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:44:01 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:44:01 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 14:44:01 user nova-compute[73052]: : NotImplementedError
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61e0f0-38e9-47cf-a81b-935a940f4305]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260]
Aug 26 14:44:01 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260] successful.
Aug 26 14:44:01 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3dd454-9777-46dc-8057-e668cc924ed6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[59116933-20be-4044-9343-1bc0bf9cb0ad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:44:01 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:44:01 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6414cb-2c13-4a5a-8bbe-f05bcdc9cf14]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:44:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:44:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:44:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26637643561393931', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:44:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637643561393931', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1882452549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1009623059',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfBT9UGn/x6RhdSNVThc9709tWxKHd6uEPnsmjrMDl00UJ5WNxNYiqynxvWwjc21UlKvegnvwH1hbCsy0UqTdMc3LUYbgvkFLENhpgsRbhQCqJRHoVO3Cf5KM4QrR4hQ==',key_name='tempest-keypair-165596234',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:41:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23b4d9738fee4f0d8670371434d086e7',ramdisk_id='',reservation_id='r-nd0jgg04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-122650918',owner_user_name='tempest-ServerActionsV293TestJSON-122650918-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe3f4a562b249adb11042d070008e2c',uuid=f0a01be4-94ff-4f2e-930f-a1e90b79abee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converting VIF {"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:44:03 user nova-compute[73052]:   <uuid>f0a01be4-94ff-4f2e-930f-a1e90b79abee</uuid>
Aug 26 14:44:03 user nova-compute[73052]:   <name>instance-0000000b</name>
Aug 26 14:44:03 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:44:03 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:44:03 user nova-compute[73052]:   <metadata>
Aug 26 14:44:03 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:44:03 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:44:03 user nova-compute[73052]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1882452549</nova:name>
Aug 26 14:44:03 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:44:01</nova:creationTime>
Aug 26 14:44:03 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:44:03 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:44:03 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:44:03 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:44:03 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:44:03 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:44:03 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:44:03 user nova-compute[73052]:       <nova:owner>
Aug 26 14:44:03 user nova-compute[73052]:         <nova:user uuid="1fe3f4a562b249adb11042d070008e2c">tempest-ServerActionsV293TestJSON-122650918-project-member</nova:user>
Aug 26 14:44:03 user nova-compute[73052]:         <nova:project uuid="23b4d9738fee4f0d8670371434d086e7">tempest-ServerActionsV293TestJSON-122650918</nova:project>
Aug 26 14:44:03 user nova-compute[73052]:       </nova:owner>
Aug 26 14:44:03 user nova-compute[73052]:       <nova:ports>
Aug 26 14:44:03 user nova-compute[73052]:         <nova:port uuid="37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5">
Aug 26 14:44:03 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 14:44:03 user nova-compute[73052]:         </nova:port>
Aug 26 14:44:03 user nova-compute[73052]:       </nova:ports>
Aug 26 14:44:03 user nova-compute[73052]:     </nova:instance>
Aug 26 14:44:03 user nova-compute[73052]:   </metadata>
Aug 26 14:44:03 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:44:03 user nova-compute[73052]:     <system>
Aug 26 14:44:03 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:44:03 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:44:03 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:44:03 user nova-compute[73052]:       <entry name="serial">f0a01be4-94ff-4f2e-930f-a1e90b79abee</entry>
Aug 26 14:44:03 user nova-compute[73052]:       <entry name="uuid">f0a01be4-94ff-4f2e-930f-a1e90b79abee</entry>
Aug 26 14:44:03 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:44:03 user nova-compute[73052]:     </system>
Aug 26 14:44:03 user nova-compute[73052]:   </sysinfo>
Aug 26 14:44:03 user nova-compute[73052]:   <os>
Aug 26 14:44:03 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:44:03 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:44:03 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:44:03 user nova-compute[73052]:   </os>
Aug 26 14:44:03 user nova-compute[73052]:   <features>
Aug 26 14:44:03 user nova-compute[73052]:     <acpi/>
Aug 26 14:44:03 user nova-compute[73052]:     <apic/>
Aug 26 14:44:03 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:44:03 user nova-compute[73052]:   </features>
Aug 26 14:44:03 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:44:03 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:44:03 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:44:03 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:44:03 user nova-compute[73052]:   </clock>
Aug 26 14:44:03 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:44:03 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:44:03 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:44:03 user nova-compute[73052]:   </cpu>
Aug 26 14:44:03 user nova-compute[73052]:   <devices>
Aug 26 14:44:03 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:44:03 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:44:03 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 14:44:03 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:44:03 user nova-compute[73052]:       <serial>c3ef495a-6902-45c5-a8b6-195f586cb84e</serial>
Aug 26 14:44:03 user nova-compute[73052]:     </disk>
Aug 26 14:44:03 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:44:03 user nova-compute[73052]:       <mac address="fa:16:3e:c7:a2:46"/>
Aug 26 14:44:03 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:44:03 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:44:03 user nova-compute[73052]:       <target dev="tap37b4ca8a-8f"/>
Aug 26 14:44:03 user nova-compute[73052]:     </interface>
Aug 26 14:44:03 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:44:03 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/f0a01be4-94ff-4f2e-930f-a1e90b79abee/console.log" append="off"/>
Aug 26 14:44:03 user nova-compute[73052]:     </serial>
Aug 26 14:44:03 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:44:03 user nova-compute[73052]:     <video>
Aug 26 14:44:03 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:44:03 user nova-compute[73052]:     </video>
Aug 26 14:44:03 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:44:03 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:44:03 user nova-compute[73052]:     </rng>
Aug 26 14:44:03 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:44:03 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:44:03 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:44:03 user nova-compute[73052]:     </memballoon>
Aug 26 14:44:03 user nova-compute[73052]:   </devices>
Aug 26 14:44:03 user nova-compute[73052]: </domain>
Aug 26 14:44:03 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1882452549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1009623059',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfBT9UGn/x6RhdSNVThc9709tWxKHd6uEPnsmjrMDl00UJ5WNxNYiqynxvWwjc21UlKvegnvwH1hbCsy0UqTdMc3LUYbgvkFLENhpgsRbhQCqJRHoVO3Cf5KM4QrR4hQ==',key_name='tempest-keypair-165596234',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:41:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23b4d9738fee4f0d8670371434d086e7',ramdisk_id='',reservation_id='r-nd0jgg04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-122650918',owner_user_name='tempest-ServerActionsV293TestJSON-122650918-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe3f4a562b249adb11042d070008e2c',uuid=f0a01be4-94ff-4f2e-930f-a1e90b79abee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converting VIF {"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG os_vif [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37b4ca8a-8f, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37b4ca8a-8f, col_values=(('external_ids', {'iface-id': '37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:a2:46', 'vm-uuid': 'f0a01be4-94ff-4f2e-930f-a1e90b79abee'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:03 user nova-compute[73052]: INFO os_vif [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f')
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:44:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] No VIF found with MAC fa:16:3e:c7:a2:46, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:44:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updating instance_info_cache with network_info: [{"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-acb26430-b816-4969-b379-720e98cf59e6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061031.0159507, 55971d31-4c54-4150-bfbd-4636df306fbd => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:06 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] VM Stopped (Lifecycle Event)
Aug 26 14:44:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-87ee27ef-afcf-4e6b-9b11-d8cf6759641e None None] [instance: 55971d31-4c54-4150-bfbd-4636df306fbd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-90c44ca3-e1e4-4bf3-a0dd-0dc648e511ba req-c01bf221-0f88-4f17-850a-4ca76517c22b service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-90c44ca3-e1e4-4bf3-a0dd-0dc648e511ba req-c01bf221-0f88-4f17-850a-4ca76517c22b service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-90c44ca3-e1e4-4bf3-a0dd-0dc648e511ba req-c01bf221-0f88-4f17-850a-4ca76517c22b service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-90c44ca3-e1e4-4bf3-a0dd-0dc648e511ba req-c01bf221-0f88-4f17-850a-4ca76517c22b service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-90c44ca3-e1e4-4bf3-a0dd-0dc648e511ba req-c01bf221-0f88-4f17-850a-4ca76517c22b service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] No waiting events found dispatching network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:44:06 user nova-compute[73052]: WARNING nova.compute.manager [req-90c44ca3-e1e4-4bf3-a0dd-0dc648e511ba req-c01bf221-0f88-4f17-850a-4ca76517c22b service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received unexpected event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061047.3951004, f0a01be4-94ff-4f2e-930f-a1e90b79abee => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] VM Resumed (Lifecycle Event)
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:44:07 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance spawned successfully.
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:44:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061047.4201725, f0a01be4-94ff-4f2e-930f-a1e90b79abee => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] VM Started (Lifecycle Event)
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:44:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73052) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f803ca65-77a8-422f-9226-c7c8eb2ffa88 tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.121s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-277f8a0e-2e49-415e-b30c-560ae9852895 req-729a5110-b6de-459a-9557-8b582c58bbbe service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-277f8a0e-2e49-415e-b30c-560ae9852895 req-729a5110-b6de-459a-9557-8b582c58bbbe service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-277f8a0e-2e49-415e-b30c-560ae9852895 req-729a5110-b6de-459a-9557-8b582c58bbbe service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-277f8a0e-2e49-415e-b30c-560ae9852895 req-729a5110-b6de-459a-9557-8b582c58bbbe service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-277f8a0e-2e49-415e-b30c-560ae9852895 req-729a5110-b6de-459a-9557-8b582c58bbbe service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] No waiting events found dispatching network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:44:08 user nova-compute[73052]: WARNING nova.compute.manager [req-277f8a0e-2e49-415e-b30c-560ae9852895 req-729a5110-b6de-459a-9557-8b582c58bbbe service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received unexpected event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 for instance with vm_state active and task_state None.
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:44:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:44:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7842MB free_disk=25.633487701416016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 79922a3f-53e3-4d29-8000-902e986e30c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance acb26430-b816-4969-b379-720e98cf59e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f0a01be4-94ff-4f2e-930f-a1e90b79abee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:44:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a0f34b07-88ee-4031-be68-73b57e1d2338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:44:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 14:44:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:44:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:44:10 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:44:10 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:44:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:44:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:12 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061037.3423226, bb7d8ce2-141a-4ba9-b545-858875307ff0 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:12 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] VM Stopped (Lifecycle Event)
Aug 26 14:44:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-33851200-f6eb-42d1-86f5-d2a5122035e1 None None] [instance: bb7d8ce2-141a-4ba9-b545-858875307ff0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:20 user nova-compute[73052]: INFO nova.compute.manager [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Terminating instance
Aug 26 14:44:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-770c9990-b489-4acc-905d-db51b4036302 req-c22544f1-1907-44f3-8f16-972d63bce74e service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received event network-vif-unplugged-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-770c9990-b489-4acc-905d-db51b4036302 req-c22544f1-1907-44f3-8f16-972d63bce74e service nova] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-770c9990-b489-4acc-905d-db51b4036302 req-c22544f1-1907-44f3-8f16-972d63bce74e service nova] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-770c9990-b489-4acc-905d-db51b4036302 req-c22544f1-1907-44f3-8f16-972d63bce74e service nova] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-770c9990-b489-4acc-905d-db51b4036302 req-c22544f1-1907-44f3-8f16-972d63bce74e service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] No waiting events found dispatching network-vif-unplugged-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:44:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-770c9990-b489-4acc-905d-db51b4036302 req-c22544f1-1907-44f3-8f16-972d63bce74e service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received event network-vif-unplugged-53db4fdc-63d5-4ca9-8e60-374c686017fa for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:44:21 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Instance destroyed successfully.
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lazy-loading 'resources' on Instance uuid fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-407864732',display_name='tempest-TestVolumeSwap-server-407864732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-407864732',id=8,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPxr7J2yNWdJoquoOjHgzTgx5OIc5VT7qbHnWGW2AxUn3jMi07q9ZE84b4BC0km5PzwEI7I9T/IcV1b28YQ/YOmUxzIAhA4XCxNAQz70T8oOfPVJLkAJ8BynWfzDZy57w==',key_name='tempest-keypair-1624247600',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c4ef05432dd4b59b77840cb11ddf674',ramdisk_id='',reservation_id='r-dwzvkj60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1983575140',owner_user_name='tempest-TestVolumeSwap-1983575140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70dd0e1eafe42b681bc51959b3e6dc9',uuid=fc07b8f2-3c64-4de9-a0a4-55121f6a90c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Converting VIF {"id": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "address": "fa:16:3e:20:dd:cc", "network": {"id": "2152ed68-4b5b-47e2-a0ab-e56d2aac419f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-732576232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4ef05432dd4b59b77840cb11ddf674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53db4fdc-63", "ovs_interfaceid": "53db4fdc-63d5-4ca9-8e60-374c686017fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:dd:cc,bridge_name='br-int',has_traffic_filtering=True,id=53db4fdc-63d5-4ca9-8e60-374c686017fa,network=Network(2152ed68-4b5b-47e2-a0ab-e56d2aac419f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53db4fdc-63') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG os_vif [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:dd:cc,bridge_name='br-int',has_traffic_filtering=True,id=53db4fdc-63d5-4ca9-8e60-374c686017fa,network=Network(2152ed68-4b5b-47e2-a0ab-e56d2aac419f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53db4fdc-63') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53db4fdc-63, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:44:21 user nova-compute[73052]: INFO os_vif [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:dd:cc,bridge_name='br-int',has_traffic_filtering=True,id=53db4fdc-63d5-4ca9-8e60-374c686017fa,network=Network(2152ed68-4b5b-47e2-a0ab-e56d2aac419f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53db4fdc-63')
Aug 26 14:44:21 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Deleting instance files /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9_del
Aug 26 14:44:21 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Deletion of /opt/stack/data/nova/instances/fc07b8f2-3c64-4de9-a0a4-55121f6a90c9_del complete
Aug 26 14:44:21 user nova-compute[73052]: INFO nova.compute.manager [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 14:44:21 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'pci_requests' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:44:21 user nova-compute[73052]: INFO nova.compute.claims [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Claim successful on node user
Aug 26 14:44:22 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:22 user nova-compute[73052]: INFO nova.network.neutron [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating port f87904f2-9bd7-46dd-a11b-4d870fbec13c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:44:22 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Took 1.21 seconds to deallocate network for instance.
Aug 26 14:44:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-eb1d1618-145b-456b-8d2e-d4e7b5f2eec9 req-3a8fa2f9-d9ff-428b-9571-2345a1e36217 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received event network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eb1d1618-145b-456b-8d2e-d4e7b5f2eec9 req-3a8fa2f9-d9ff-428b-9571-2345a1e36217 service nova] Acquiring lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eb1d1618-145b-456b-8d2e-d4e7b5f2eec9 req-3a8fa2f9-d9ff-428b-9571-2345a1e36217 service nova] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eb1d1618-145b-456b-8d2e-d4e7b5f2eec9 req-3a8fa2f9-d9ff-428b-9571-2345a1e36217 service nova] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-eb1d1618-145b-456b-8d2e-d4e7b5f2eec9 req-3a8fa2f9-d9ff-428b-9571-2345a1e36217 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] No waiting events found dispatching network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:44:22 user nova-compute[73052]: WARNING nova.compute.manager [req-eb1d1618-145b-456b-8d2e-d4e7b5f2eec9 req-3a8fa2f9-d9ff-428b-9571-2345a1e36217 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received unexpected event network-vif-plugged-53db4fdc-63d5-4ca9-8e60-374c686017fa for instance with vm_state deleted and task_state None.
Aug 26 14:44:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-eb1d1618-145b-456b-8d2e-d4e7b5f2eec9 req-3a8fa2f9-d9ff-428b-9571-2345a1e36217 service nova] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Received event network-vif-deleted-53db4fdc-63d5-4ca9-8e60-374c686017fa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:44:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:23 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Deleted allocations for instance fc07b8f2-3c64-4de9-a0a4-55121f6a90c9
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d58823b4-ad95-4180-ae4b-979636254fac tempest-TestVolumeSwap-1983575140 tempest-TestVolumeSwap-1983575140-project-member] Lock "fc07b8f2-3c64-4de9-a0a4-55121f6a90c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.784s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquired lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-db3920e5-68c3-477f-809e-305ee9c8f55d req-7602f2d8-b220-4ad0-895c-4dd0631837e2 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-changed-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-db3920e5-68c3-477f-809e-305ee9c8f55d req-7602f2d8-b220-4ad0-895c-4dd0631837e2 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Refreshing instance network info cache due to event network-changed-f87904f2-9bd7-46dd-a11b-4d870fbec13c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db3920e5-68c3-477f-809e-305ee9c8f55d req-7602f2d8-b220-4ad0-895c-4dd0631837e2 service nova] Acquiring lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating instance_info_cache with network_info: [{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Releasing lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:44:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Creating image(s)
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db3920e5-68c3-477f-809e-305ee9c8f55d req-7602f2d8-b220-4ad0-895c-4dd0631837e2 service nova] Acquired lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG nova.network.neutron [req-db3920e5-68c3-477f-809e-305ee9c8f55d req-7602f2d8-b220-4ad0-895c-4dd0631837e2 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Refreshing network info cache for port f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG nova.objects.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<2e4f1fd3-d09f-4f6e-abda-9db2158eb46c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "3d2f3cfcfd007834e24183ba988208038fd30fb3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "3d2f3cfcfd007834e24183ba988208038fd30fb3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:24 user nova-compute[73052]: DEBUG nova.virt.images [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] 999f4e48-450c-4184-ba8d-71a1c7e4c907 was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 14:44:24 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:44:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3.part /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG nova.network.neutron [req-db3920e5-68c3-477f-809e-305ee9c8f55d req-7602f2d8-b220-4ad0-895c-4dd0631837e2 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updated VIF entry in instance network info cache for port f87904f2-9bd7-46dd-a11b-4d870fbec13c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG nova.network.neutron [req-db3920e5-68c3-477f-809e-305ee9c8f55d req-7602f2d8-b220-4ad0-895c-4dd0631837e2 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating instance_info_cache with network_info: [{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db3920e5-68c3-477f-809e-305ee9c8f55d req-7602f2d8-b220-4ad0-895c-4dd0631837e2 service nova] Releasing lock "refresh_cache-2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3.part /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3.converted" returned: 0 in 0.537s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "3d2f3cfcfd007834e24183ba988208038fd30fb3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.923s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3 --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "3d2f3cfcfd007834e24183ba988208038fd30fb3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "3d2f3cfcfd007834e24183ba988208038fd30fb3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3 --force-share --output=json" returned: 0 in 0.203s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3,backing_fmt=raw /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3,backing_fmt=raw /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk 1073741824" returned: 0 in 0.052s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "3d2f3cfcfd007834e24183ba988208038fd30fb3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3 --force-share --output=json" returned: 0 in 0.217s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'migration_context' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG nova.objects.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<2e4f1fd3-d09f-4f6e-abda-9db2158eb46c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Rebasing disk image.
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a -F raw /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a -F raw /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk" returned: 0 in 2.736s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Ensure instance console log exists: /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Start _get_guest_xml network_info=[{"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='20c92fcc2218c6698239ffe0de7b4c55',container_format='bare',created_at=2023-08-26T14:42:05Z,direct_url=<?>,disk_format='qcow2',id=999f4e48-450c-4184-ba8d-71a1c7e4c907,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-488685255-shelved',owner='267e3757f3624d869a2e5e3d31376b5c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T14:42:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '04176ae3-7d1f-46df-9660-dffd0d10e6d1', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDtoRHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '2e4f1fd3-d09f-4f6e-abda-9db2158eb46c', 'attached_at': '', 'detached_at': '', 'volume_id': '747d94fe-075a-427a-8a29-ff09feba9875', 'serial': '747d94fe-075a-427a-8a29-ff09feba9875'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:44:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:44:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='20c92fcc2218c6698239ffe0de7b4c55',container_format='bare',created_at=2023-08-26T14:42:05Z,direct_url=<?>,disk_format='qcow2',id=999f4e48-450c-4184-ba8d-71a1c7e4c907,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-488685255-shelved',owner='267e3757f3624d869a2e5e3d31376b5c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T14:42:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<2e4f1fd3-d09f-4f6e-abda-9db2158eb46c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDtoRHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:44:29 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:44:29 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.043s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:44:29 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[932c157f-7b30-4ddc-8acb-53c9bac265f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:44:29 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc71ee00-03c2-4d2e-a473-fd3025408408]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875] added
Aug 26 14:44:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbff847b-eda0-4957-820e-b67c0f4e9ef0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[731bdf29-d1e2-457e-894e-b6dc09c5562e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpDtoRHX {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpDtoRHX" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b241919-d311-454e-a51c-872c1ddcc63e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpDtoRHX'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5814e7-d397-43b4-983b-a59f1a5ac1b7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2df400-65df-4c72-a33e-766afb0aa475]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:44:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:44:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaea27c1-1a88-4df9-add0-a42e34b44f5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875, portal: 172.16.0.220,3260]
Aug 26 14:44:29 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875, portal: 172.16.0.220,3260] successful.
Aug 26 14:44:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af5f65f-4225-48de-85e3-4e80ab74a07d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb714c4e-1a9d-434d-814c-a07207e82ba2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:44:29 user nova-compute[73052]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)
Aug 26 14:44:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:44:29 user nova-compute[73052]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)
Aug 26 14:44:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0402d717-66d7-4cd9-8a66-32f1f4359637]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:44:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDtoRHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] <== connect_volume: return (1540ms) {'type': 'block', 'scsi_wwn': '26330323062636265', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330323062636265', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-488685255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-488685255',id=4,image_ref='999f4e48-450c-4184-ba8d-71a1c7e4c907',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-856206061',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-qy7djzrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member',shelved_at='2023-08-26T14:42:12.199134',shelved_host='user',shelved_image_id='999f4e48-450c-4184-ba8d-71a1c7e4c907'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=2e4f1fd3-d09f-4f6e-abda-9db2158eb46c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG nova.objects.base [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<2e4f1fd3-d09f-4f6e-abda-9db2158eb46c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:44:30 user nova-compute[73052]:   <uuid>2e4f1fd3-d09f-4f6e-abda-9db2158eb46c</uuid>
Aug 26 14:44:30 user nova-compute[73052]:   <name>instance-00000004</name>
Aug 26 14:44:30 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:44:30 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:44:30 user nova-compute[73052]:   <metadata>
Aug 26 14:44:30 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:44:30 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:44:30 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-488685255</nova:name>
Aug 26 14:44:30 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:44:29</nova:creationTime>
Aug 26 14:44:30 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:44:30 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:44:30 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:44:30 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:44:30 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:44:30 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:44:30 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:44:30 user nova-compute[73052]:       <nova:owner>
Aug 26 14:44:30 user nova-compute[73052]:         <nova:user uuid="e2513642eea3411b9c8c33714bd2f3b3">tempest-AttachVolumeShelveTestJSON-1914851903-project-member</nova:user>
Aug 26 14:44:30 user nova-compute[73052]:         <nova:project uuid="267e3757f3624d869a2e5e3d31376b5c">tempest-AttachVolumeShelveTestJSON-1914851903</nova:project>
Aug 26 14:44:30 user nova-compute[73052]:       </nova:owner>
Aug 26 14:44:30 user nova-compute[73052]:       <nova:root type="image" uuid="999f4e48-450c-4184-ba8d-71a1c7e4c907"/>
Aug 26 14:44:30 user nova-compute[73052]:       <nova:ports>
Aug 26 14:44:30 user nova-compute[73052]:         <nova:port uuid="f87904f2-9bd7-46dd-a11b-4d870fbec13c">
Aug 26 14:44:30 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 14:44:30 user nova-compute[73052]:         </nova:port>
Aug 26 14:44:30 user nova-compute[73052]:       </nova:ports>
Aug 26 14:44:30 user nova-compute[73052]:     </nova:instance>
Aug 26 14:44:30 user nova-compute[73052]:   </metadata>
Aug 26 14:44:30 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:44:30 user nova-compute[73052]:     <system>
Aug 26 14:44:30 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:44:30 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:44:30 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:44:30 user nova-compute[73052]:       <entry name="serial">2e4f1fd3-d09f-4f6e-abda-9db2158eb46c</entry>
Aug 26 14:44:30 user nova-compute[73052]:       <entry name="uuid">2e4f1fd3-d09f-4f6e-abda-9db2158eb46c</entry>
Aug 26 14:44:30 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:44:30 user nova-compute[73052]:     </system>
Aug 26 14:44:30 user nova-compute[73052]:   </sysinfo>
Aug 26 14:44:30 user nova-compute[73052]:   <os>
Aug 26 14:44:30 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:44:30 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:44:30 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:44:30 user nova-compute[73052]:   </os>
Aug 26 14:44:30 user nova-compute[73052]:   <features>
Aug 26 14:44:30 user nova-compute[73052]:     <acpi/>
Aug 26 14:44:30 user nova-compute[73052]:     <apic/>
Aug 26 14:44:30 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:44:30 user nova-compute[73052]:   </features>
Aug 26 14:44:30 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:44:30 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:44:30 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:44:30 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:44:30 user nova-compute[73052]:   </clock>
Aug 26 14:44:30 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:44:30 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:44:30 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:44:30 user nova-compute[73052]:   </cpu>
Aug 26 14:44:30 user nova-compute[73052]:   <devices>
Aug 26 14:44:30 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:44:30 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:44:30 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk"/>
Aug 26 14:44:30 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:44:30 user nova-compute[73052]:     </disk>
Aug 26 14:44:30 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:44:30 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:44:30 user nova-compute[73052]:       <source dev="/dev/sdc"/>
Aug 26 14:44:30 user nova-compute[73052]:       <target dev="vdc" bus="virtio"/>
Aug 26 14:44:30 user nova-compute[73052]:       <serial>747d94fe-075a-427a-8a29-ff09feba9875</serial>
Aug 26 14:44:30 user nova-compute[73052]:     </disk>
Aug 26 14:44:30 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:44:30 user nova-compute[73052]:       <mac address="fa:16:3e:fb:18:36"/>
Aug 26 14:44:30 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:44:30 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:44:30 user nova-compute[73052]:       <target dev="tapf87904f2-9b"/>
Aug 26 14:44:30 user nova-compute[73052]:     </interface>
Aug 26 14:44:30 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:44:30 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/console.log" append="off"/>
Aug 26 14:44:30 user nova-compute[73052]:     </serial>
Aug 26 14:44:30 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:44:30 user nova-compute[73052]:     <video>
Aug 26 14:44:30 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:44:30 user nova-compute[73052]:     </video>
Aug 26 14:44:30 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:44:30 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:44:30 user nova-compute[73052]:     </rng>
Aug 26 14:44:30 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:44:30 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:44:30 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:44:30 user nova-compute[73052]:     </memballoon>
Aug 26 14:44:30 user nova-compute[73052]:   </devices>
Aug 26 14:44:30 user nova-compute[73052]: </domain>
Aug 26 14:44:30 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-488685255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-488685255',id=4,image_ref='999f4e48-450c-4184-ba8d-71a1c7e4c907',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-856206061',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-qy7djzrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member',shelved_at='2023-08-26T14:42:12.199134',shelved_host='user',shelved_image_id='999f4e48-450c-4184-ba8d-71a1c7e4c907'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=2e4f1fd3-d09f-4f6e-abda-9db2158eb46c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG os_vif [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf87904f2-9b, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf87904f2-9b, col_values=(('external_ids', {'iface-id': 'f87904f2-9bd7-46dd-a11b-4d870fbec13c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:18:36', 'vm-uuid': '2e4f1fd3-d09f-4f6e-abda-9db2158eb46c'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:31 user nova-compute[73052]: INFO os_vif [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b')
Aug 26 14:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No VIF found with MAC fa:16:3e:fb:18:36, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:44:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-355d92e7-9552-4bd1-83ee-1f0c075b7b32 req-ae02fd6d-f823-487e-b2a4-3f52c93c22e9 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-355d92e7-9552-4bd1-83ee-1f0c075b7b32 req-ae02fd6d-f823-487e-b2a4-3f52c93c22e9 service nova] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-355d92e7-9552-4bd1-83ee-1f0c075b7b32 req-ae02fd6d-f823-487e-b2a4-3f52c93c22e9 service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-355d92e7-9552-4bd1-83ee-1f0c075b7b32 req-ae02fd6d-f823-487e-b2a4-3f52c93c22e9 service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-355d92e7-9552-4bd1-83ee-1f0c075b7b32 req-ae02fd6d-f823-487e-b2a4-3f52c93c22e9 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] No waiting events found dispatching network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:44:32 user nova-compute[73052]: WARNING nova.compute.manager [req-355d92e7-9552-4bd1-83ee-1f0c075b7b32 req-ae02fd6d-f823-487e-b2a4-3f52c93c22e9 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received unexpected event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 14:44:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-e0703f02-1b2f-475f-8b23-f7d036d764d1 req-64216aed-2e50-4866-a765-0cc7c987e4b6 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e0703f02-1b2f-475f-8b23-f7d036d764d1 req-64216aed-2e50-4866-a765-0cc7c987e4b6 service nova] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e0703f02-1b2f-475f-8b23-f7d036d764d1 req-64216aed-2e50-4866-a765-0cc7c987e4b6 service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e0703f02-1b2f-475f-8b23-f7d036d764d1 req-64216aed-2e50-4866-a765-0cc7c987e4b6 service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-e0703f02-1b2f-475f-8b23-f7d036d764d1 req-64216aed-2e50-4866-a765-0cc7c987e4b6 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] No waiting events found dispatching network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:44:34 user nova-compute[73052]: WARNING nova.compute.manager [req-e0703f02-1b2f-475f-8b23-f7d036d764d1 req-64216aed-2e50-4866-a765-0cc7c987e4b6 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received unexpected event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061075.393483, 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:35 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] VM Resumed (Lifecycle Event)
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:44:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance spawned successfully.
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:44:35 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061075.395658, 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:35 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] VM Started (Lifecycle Event)
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:44:35 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:44:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bc7863bc-69a0-4577-a4bb-3957089e1572 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 36.826s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:36 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061061.133005, fc07b8f2-3c64-4de9-a0a4-55121f6a90c9 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:36 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] VM Stopped (Lifecycle Event)
Aug 26 14:44:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-06cd7d92-d300-4511-a919-7aea55d0c98e None None] [instance: fc07b8f2-3c64-4de9-a0a4-55121f6a90c9] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:52 user nova-compute[73052]: INFO nova.compute.manager [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Rescuing
Aug 26 14:44:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:44:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquired lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:44:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:44:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:53 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:44:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Releasing lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:44:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-31f65319-fa8f-4b6b-9009-28348e6fd2b3 req-b8f96ba1-618b-4123-a3d9-c2f11d43abd7 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-31f65319-fa8f-4b6b-9009-28348e6fd2b3 req-b8f96ba1-618b-4123-a3d9-c2f11d43abd7 service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-31f65319-fa8f-4b6b-9009-28348e6fd2b3 req-b8f96ba1-618b-4123-a3d9-c2f11d43abd7 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-31f65319-fa8f-4b6b-9009-28348e6fd2b3 req-b8f96ba1-618b-4123-a3d9-c2f11d43abd7 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-31f65319-fa8f-4b6b-9009-28348e6fd2b3 req-b8f96ba1-618b-4123-a3d9-c2f11d43abd7 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:44:54 user nova-compute[73052]: WARNING nova.compute.manager [req-31f65319-fa8f-4b6b-9009-28348e6fd2b3 req-b8f96ba1-618b-4123-a3d9-c2f11d43abd7 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state active and task_state rescuing.
Aug 26 14:44:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance destroyed successfully.
Aug 26 14:44:54 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Attempting rescue
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73052) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance directory exists: not creating {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 14:44:54 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Creating image(s)
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'trusted_certs' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.261s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue" returned: 0 in 0.065s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'migration_context' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.objects.base [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Start _get_guest_xml network_info=[{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:d9:a9:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'resources' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.objects.base [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'numa_topology' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.objects.base [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:55 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:44:55 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.objects.base [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-306863605',display_name='tempest-ServerRescueNegativeTestJSON-server-306863605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-306863605',id=2,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-x7v6rmb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:40:13Z,user_data=None,user_id='966347969be04bb9a69cbdc441a94d8f',uuid=36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:d9:a9:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:d9:a9:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:a9:06,bridge_name='br-int',has_traffic_filtering=True,id=f91967ed-1d90-4f7a-9265-4d13731fa7ef,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91967ed-1d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'pci_devices' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.objects.base [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:44:55 user nova-compute[73052]:   <uuid>36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749</uuid>
Aug 26 14:44:55 user nova-compute[73052]:   <name>instance-00000002</name>
Aug 26 14:44:55 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:44:55 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:44:55 user nova-compute[73052]:   <metadata>
Aug 26 14:44:55 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:44:55 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:44:55 user nova-compute[73052]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-306863605</nova:name>
Aug 26 14:44:55 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:44:55</nova:creationTime>
Aug 26 14:44:55 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:44:55 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:44:55 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:44:55 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:44:55 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:44:55 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:44:55 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:44:55 user nova-compute[73052]:       <nova:owner>
Aug 26 14:44:55 user nova-compute[73052]:         <nova:user uuid="966347969be04bb9a69cbdc441a94d8f">tempest-ServerRescueNegativeTestJSON-2104819576-project-member</nova:user>
Aug 26 14:44:55 user nova-compute[73052]:         <nova:project uuid="6426cc5de72e40e4ba4570304328a568">tempest-ServerRescueNegativeTestJSON-2104819576</nova:project>
Aug 26 14:44:55 user nova-compute[73052]:       </nova:owner>
Aug 26 14:44:55 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:44:55 user nova-compute[73052]:       <nova:ports>
Aug 26 14:44:55 user nova-compute[73052]:         <nova:port uuid="f91967ed-1d90-4f7a-9265-4d13731fa7ef">
Aug 26 14:44:55 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 14:44:55 user nova-compute[73052]:         </nova:port>
Aug 26 14:44:55 user nova-compute[73052]:       </nova:ports>
Aug 26 14:44:55 user nova-compute[73052]:     </nova:instance>
Aug 26 14:44:55 user nova-compute[73052]:   </metadata>
Aug 26 14:44:55 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:44:55 user nova-compute[73052]:     <system>
Aug 26 14:44:55 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:44:55 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:44:55 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:44:55 user nova-compute[73052]:       <entry name="serial">36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749</entry>
Aug 26 14:44:55 user nova-compute[73052]:       <entry name="uuid">36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749</entry>
Aug 26 14:44:55 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:44:55 user nova-compute[73052]:     </system>
Aug 26 14:44:55 user nova-compute[73052]:   </sysinfo>
Aug 26 14:44:55 user nova-compute[73052]:   <os>
Aug 26 14:44:55 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:44:55 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:44:55 user nova-compute[73052]:   </os>
Aug 26 14:44:55 user nova-compute[73052]:   <features>
Aug 26 14:44:55 user nova-compute[73052]:     <acpi/>
Aug 26 14:44:55 user nova-compute[73052]:     <apic/>
Aug 26 14:44:55 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:44:55 user nova-compute[73052]:   </features>
Aug 26 14:44:55 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:44:55 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:44:55 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:44:55 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:44:55 user nova-compute[73052]:   </clock>
Aug 26 14:44:55 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:44:55 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:44:55 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:44:55 user nova-compute[73052]:   </cpu>
Aug 26 14:44:55 user nova-compute[73052]:   <devices>
Aug 26 14:44:55 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:44:55 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:44:55 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue"/>
Aug 26 14:44:55 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:44:55 user nova-compute[73052]:     </disk>
Aug 26 14:44:55 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:44:55 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:44:55 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk"/>
Aug 26 14:44:55 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:44:55 user nova-compute[73052]:     </disk>
Aug 26 14:44:55 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:44:55 user nova-compute[73052]:       <mac address="fa:16:3e:d9:a9:06"/>
Aug 26 14:44:55 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:44:55 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:44:55 user nova-compute[73052]:       <target dev="tapf91967ed-1d"/>
Aug 26 14:44:55 user nova-compute[73052]:     </interface>
Aug 26 14:44:55 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:44:55 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/console.log" append="off"/>
Aug 26 14:44:55 user nova-compute[73052]:     </serial>
Aug 26 14:44:55 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:44:55 user nova-compute[73052]:     <video>
Aug 26 14:44:55 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:44:55 user nova-compute[73052]:     </video>
Aug 26 14:44:55 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:44:55 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:44:55 user nova-compute[73052]:     </rng>
Aug 26 14:44:55 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:44:55 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:44:55 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:44:55 user nova-compute[73052]:     </memballoon>
Aug 26 14:44:55 user nova-compute[73052]:   </devices>
Aug 26 14:44:55 user nova-compute[73052]: </domain>
Aug 26 14:44:55 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:55 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance destroyed successfully.
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:44:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No VIF found with MAC fa:16:3e:d9:a9:06, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:44:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:56 user nova-compute[73052]: DEBUG nova.compute.manager [req-f6644d92-80a4-4987-bd21-9b22acf9b8a1 req-51c51a8b-8e68-4a93-a021-5345c28414b4 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:44:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f6644d92-80a4-4987-bd21-9b22acf9b8a1 req-51c51a8b-8e68-4a93-a021-5345c28414b4 service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f6644d92-80a4-4987-bd21-9b22acf9b8a1 req-51c51a8b-8e68-4a93-a021-5345c28414b4 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f6644d92-80a4-4987-bd21-9b22acf9b8a1 req-51c51a8b-8e68-4a93-a021-5345c28414b4 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:44:56 user nova-compute[73052]: DEBUG nova.compute.manager [req-f6644d92-80a4-4987-bd21-9b22acf9b8a1 req-51c51a8b-8e68-4a93-a021-5345c28414b4 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:44:56 user nova-compute[73052]: WARNING nova.compute.manager [req-f6644d92-80a4-4987-bd21-9b22acf9b8a1 req-51c51a8b-8e68-4a93-a021-5345c28414b4 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state active and task_state rescuing.
Aug 26 14:44:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061099.3579197, 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:59 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] VM Resumed (Lifecycle Event)
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0151355f-55e0-470e-8486-d2ff7c253297 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:44:59 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061099.3582983, 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:44:59 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] VM Started (Lifecycle Event)
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:44:59 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:44:59 user nova-compute[73052]: INFO nova.compute.claims [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Claim successful on node user
Aug 26 14:45:00 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:45:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:45:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:45:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:45:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:45:00 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:45:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:45:00 user nova-compute[73052]: INFO nova.virt.block_device [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Booting with volume 4963a10b-980c-49ed-b597-c8cf6cc642c7 at /dev/vda
Aug 26 14:45:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG os_brick.utils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3e65f7-e54e-4a3b-81a6-387ffa19789b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[57be2345-ea23-4512-92a0-f817d229a983]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d5e09e-ffdf-4d0f-aef7-bfa39e3bee1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b6ccd7-7be0-459b-a1bb-6e7759c4f3fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:45:01 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d560ef5d-c2ff-44bd-b69a-1b05c58ab484]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG os_brick.utils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating existing volume attachment record: bebbbaf1-5dfd-4be3-9777-253d1a4ae1ea {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG nova.policy [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fba7e44b19654bf9b0532eb53725b1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fbf87994b3497c86c16c8ce605aaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-177f50f7-b863-4569-acc8-481d4b5dc7d2 req-ecd94a85-c3b1-499e-90ef-35a0a518b9fd service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-177f50f7-b863-4569-acc8-481d4b5dc7d2 req-ecd94a85-c3b1-499e-90ef-35a0a518b9fd service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-177f50f7-b863-4569-acc8-481d4b5dc7d2 req-ecd94a85-c3b1-499e-90ef-35a0a518b9fd service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-177f50f7-b863-4569-acc8-481d4b5dc7d2 req-ecd94a85-c3b1-499e-90ef-35a0a518b9fd service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-177f50f7-b863-4569-acc8-481d4b5dc7d2 req-ecd94a85-c3b1-499e-90ef-35a0a518b9fd service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:45:01 user nova-compute[73052]: WARNING nova.compute.manager [req-177f50f7-b863-4569-acc8-481d4b5dc7d2 req-ecd94a85-c3b1-499e-90ef-35a0a518b9fd service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state rescued and task_state None.
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:45:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:02 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:45:02 user nova-compute[73052]: INFO nova.compute.claims [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Claim successful on node user
Aug 26 14:45:02 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:45:02 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:45:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.764s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:45:03 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.policy [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3f305d2512943078f5523a3ab1714d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08a7ce6c2c74c688c44fabc053c39cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:45:03 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Creating image(s)
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "/opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "/opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "/opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully created port: 3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.270s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.260s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-5eecc4a1-1eb8-4a7e-8a05-52c1df2ee473 req-9f0dbcf4-3dee-4b53-889a-28f47c9d8e93 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5eecc4a1-1eb8-4a7e-8a05-52c1df2ee473 req-9f0dbcf4-3dee-4b53-889a-28f47c9d8e93 service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5eecc4a1-1eb8-4a7e-8a05-52c1df2ee473 req-9f0dbcf4-3dee-4b53-889a-28f47c9d8e93 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5eecc4a1-1eb8-4a7e-8a05-52c1df2ee473 req-9f0dbcf4-3dee-4b53-889a-28f47c9d8e93 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-5eecc4a1-1eb8-4a7e-8a05-52c1df2ee473 req-9f0dbcf4-3dee-4b53-889a-28f47c9d8e93 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:45:03 user nova-compute[73052]: WARNING nova.compute.manager [req-5eecc4a1-1eb8-4a7e-8a05-52c1df2ee473 req-9f0dbcf4-3dee-4b53-889a-28f47c9d8e93 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state rescued and task_state None.
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk 1073741824" returned: 0 in 0.106s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.230s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Successfully created port: 8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Cannot resize image /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Ensure instance console log exists: /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:04 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully created port: 62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:45:05 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully created port: da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:45:05 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Successfully updated port: 8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquired lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:05 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:45:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:05 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-4b01b4eb-6e26-49ae-b160-4690b839533d req-0705b239-c350-41a0-9cda-1779c8bb2d2d service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received event network-changed-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-4b01b4eb-6e26-49ae-b160-4690b839533d req-0705b239-c350-41a0-9cda-1779c8bb2d2d service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Refreshing instance network info cache due to event network-changed-8b6ce89f-520f-4036-82f8-aff1776d0b75. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4b01b4eb-6e26-49ae-b160-4690b839533d req-0705b239-c350-41a0-9cda-1779c8bb2d2d service nova] Acquiring lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating instance_info_cache with network_info: [{"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Releasing lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Instance network_info: |[{"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4b01b4eb-6e26-49ae-b160-4690b839533d req-0705b239-c350-41a0-9cda-1779c8bb2d2d service nova] Acquired lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.network.neutron [req-4b01b4eb-6e26-49ae-b160-4690b839533d req-0705b239-c350-41a0-9cda-1779c8bb2d2d service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Refreshing network info cache for port 8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Start _get_guest_xml network_info=[{"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:45:06 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:45:06 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-947691108',display_name='tempest-SnapshotDataIntegrityTests-server-947691108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-947691108',id=15,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFARuMWaLpakQC1Chj5dvFlLhFbhL3fqQQApOyrJZDcX18w2H/jHD4+P2UYoItEfr9CGTp2aGeEoBW08djudZ+SOMDbVDkybww9hYmp6J+qWKRToUaBIMpKVW4kQvDUxyA==',key_name='tempest-keypair-705788914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b08a7ce6c2c74c688c44fabc053c39cb',ramdisk_id='',reservation_id='r-f9zjhl30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1799889378',owner_user_name='tempest-SnapshotDataIntegrityTests-1799889378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f305d2512943078f5523a3ab1714d3',uuid=92558f0f-dc80-4acf-b3b9-27d0244c0ddb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Converting VIF {"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:f0,bridge_name='br-int',has_traffic_filtering=True,id=8b6ce89f-520f-4036-82f8-aff1776d0b75,network=Network(a1f0df7f-0f79-440e-b39d-ae68b13a7832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6ce89f-52') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.objects.instance [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'pci_devices' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:45:06 user nova-compute[73052]:   <uuid>92558f0f-dc80-4acf-b3b9-27d0244c0ddb</uuid>
Aug 26 14:45:06 user nova-compute[73052]:   <name>instance-0000000f</name>
Aug 26 14:45:06 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:45:06 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:45:06 user nova-compute[73052]:   <metadata>
Aug 26 14:45:06 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:45:06 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:45:06 user nova-compute[73052]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-947691108</nova:name>
Aug 26 14:45:06 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:45:06</nova:creationTime>
Aug 26 14:45:06 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:45:06 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:45:06 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:45:06 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:45:06 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:45:06 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:45:06 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:45:06 user nova-compute[73052]:       <nova:owner>
Aug 26 14:45:06 user nova-compute[73052]:         <nova:user uuid="e3f305d2512943078f5523a3ab1714d3">tempest-SnapshotDataIntegrityTests-1799889378-project-member</nova:user>
Aug 26 14:45:06 user nova-compute[73052]:         <nova:project uuid="b08a7ce6c2c74c688c44fabc053c39cb">tempest-SnapshotDataIntegrityTests-1799889378</nova:project>
Aug 26 14:45:06 user nova-compute[73052]:       </nova:owner>
Aug 26 14:45:06 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:45:06 user nova-compute[73052]:       <nova:ports>
Aug 26 14:45:06 user nova-compute[73052]:         <nova:port uuid="8b6ce89f-520f-4036-82f8-aff1776d0b75">
Aug 26 14:45:06 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 14:45:06 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:06 user nova-compute[73052]:       </nova:ports>
Aug 26 14:45:06 user nova-compute[73052]:     </nova:instance>
Aug 26 14:45:06 user nova-compute[73052]:   </metadata>
Aug 26 14:45:06 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:45:06 user nova-compute[73052]:     <system>
Aug 26 14:45:06 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:45:06 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:45:06 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:45:06 user nova-compute[73052]:       <entry name="serial">92558f0f-dc80-4acf-b3b9-27d0244c0ddb</entry>
Aug 26 14:45:06 user nova-compute[73052]:       <entry name="uuid">92558f0f-dc80-4acf-b3b9-27d0244c0ddb</entry>
Aug 26 14:45:06 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:45:06 user nova-compute[73052]:     </system>
Aug 26 14:45:06 user nova-compute[73052]:   </sysinfo>
Aug 26 14:45:06 user nova-compute[73052]:   <os>
Aug 26 14:45:06 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:45:06 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:45:06 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:45:06 user nova-compute[73052]:   </os>
Aug 26 14:45:06 user nova-compute[73052]:   <features>
Aug 26 14:45:06 user nova-compute[73052]:     <acpi/>
Aug 26 14:45:06 user nova-compute[73052]:     <apic/>
Aug 26 14:45:06 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:45:06 user nova-compute[73052]:   </features>
Aug 26 14:45:06 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:45:06 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:45:06 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:45:06 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:45:06 user nova-compute[73052]:   </clock>
Aug 26 14:45:06 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:45:06 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:45:06 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:45:06 user nova-compute[73052]:   </cpu>
Aug 26 14:45:06 user nova-compute[73052]:   <devices>
Aug 26 14:45:06 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:45:06 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:45:06 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk"/>
Aug 26 14:45:06 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:45:06 user nova-compute[73052]:     </disk>
Aug 26 14:45:06 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:06 user nova-compute[73052]:       <mac address="fa:16:3e:51:e9:f0"/>
Aug 26 14:45:06 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:06 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:06 user nova-compute[73052]:       <target dev="tap8b6ce89f-52"/>
Aug 26 14:45:06 user nova-compute[73052]:     </interface>
Aug 26 14:45:06 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:45:06 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/console.log" append="off"/>
Aug 26 14:45:06 user nova-compute[73052]:     </serial>
Aug 26 14:45:06 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:45:06 user nova-compute[73052]:     <video>
Aug 26 14:45:06 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:06 user nova-compute[73052]:     </video>
Aug 26 14:45:06 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:45:06 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:45:06 user nova-compute[73052]:     </rng>
Aug 26 14:45:06 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:45:06 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:45:06 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:45:06 user nova-compute[73052]:     </memballoon>
Aug 26 14:45:06 user nova-compute[73052]:   </devices>
Aug 26 14:45:06 user nova-compute[73052]: </domain>
Aug 26 14:45:06 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-947691108',display_name='tempest-SnapshotDataIntegrityTests-server-947691108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-947691108',id=15,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFARuMWaLpakQC1Chj5dvFlLhFbhL3fqQQApOyrJZDcX18w2H/jHD4+P2UYoItEfr9CGTp2aGeEoBW08djudZ+SOMDbVDkybww9hYmp6J+qWKRToUaBIMpKVW4kQvDUxyA==',key_name='tempest-keypair-705788914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b08a7ce6c2c74c688c44fabc053c39cb',ramdisk_id='',reservation_id='r-f9zjhl30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1799889378',owner_user_name='tempest-SnapshotDataIntegrityTests-1799889378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f305d2512943078f5523a3ab1714d3',uuid=92558f0f-dc80-4acf-b3b9-27d0244c0ddb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Converting VIF {"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:f0,bridge_name='br-int',has_traffic_filtering=True,id=8b6ce89f-520f-4036-82f8-aff1776d0b75,network=Network(a1f0df7f-0f79-440e-b39d-ae68b13a7832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6ce89f-52') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG os_vif [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:f0,bridge_name='br-int',has_traffic_filtering=True,id=8b6ce89f-520f-4036-82f8-aff1776d0b75,network=Network(a1f0df7f-0f79-440e-b39d-ae68b13a7832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6ce89f-52') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b6ce89f-52, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b6ce89f-52, col_values=(('external_ids', {'iface-id': '8b6ce89f-520f-4036-82f8-aff1776d0b75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:e9:f0', 'vm-uuid': '92558f0f-dc80-4acf-b3b9-27d0244c0ddb'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:06 user nova-compute[73052]: INFO os_vif [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:f0,bridge_name='br-int',has_traffic_filtering=True,id=8b6ce89f-520f-4036-82f8-aff1776d0b75,network=Network(a1f0df7f-0f79-440e-b39d-ae68b13a7832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6ce89f-52')
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No VIF found with MAC fa:16:3e:51:e9:f0, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:45:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully created port: 3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:45:07 user nova-compute[73052]: DEBUG nova.network.neutron [req-4b01b4eb-6e26-49ae-b160-4690b839533d req-0705b239-c350-41a0-9cda-1779c8bb2d2d service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updated VIF entry in instance network info cache for port 8b6ce89f-520f-4036-82f8-aff1776d0b75. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:45:07 user nova-compute[73052]: DEBUG nova.network.neutron [req-4b01b4eb-6e26-49ae-b160-4690b839533d req-0705b239-c350-41a0-9cda-1779c8bb2d2d service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating instance_info_cache with network_info: [{"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4b01b4eb-6e26-49ae-b160-4690b839533d req-0705b239-c350-41a0-9cda-1779c8bb2d2d service nova] Releasing lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:07 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully created port: b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-9a1a9ee9-023e-4189-96bf-a14e6bd618d0 req-f3d85eae-b8ad-4348-97c0-16b011132f1a service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received event network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9a1a9ee9-023e-4189-96bf-a14e6bd618d0 req-f3d85eae-b8ad-4348-97c0-16b011132f1a service nova] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9a1a9ee9-023e-4189-96bf-a14e6bd618d0 req-f3d85eae-b8ad-4348-97c0-16b011132f1a service nova] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9a1a9ee9-023e-4189-96bf-a14e6bd618d0 req-f3d85eae-b8ad-4348-97c0-16b011132f1a service nova] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-9a1a9ee9-023e-4189-96bf-a14e6bd618d0 req-f3d85eae-b8ad-4348-97c0-16b011132f1a service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] No waiting events found dispatching network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:45:08 user nova-compute[73052]: WARNING nova.compute.manager [req-9a1a9ee9-023e-4189-96bf-a14e6bd618d0 req-f3d85eae-b8ad-4348-97c0-16b011132f1a service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received unexpected event network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 for instance with vm_state building and task_state spawning.
Aug 26 14:45:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully updated port: 3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-f10484db-cd6f-4ccf-be5b-ff587821b87a req-1b06e381-99cb-4e19-81a8-06e1ee11fe2a service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-changed-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-f10484db-cd6f-4ccf-be5b-ff587821b87a req-1b06e381-99cb-4e19-81a8-06e1ee11fe2a service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing instance network info cache due to event network-changed-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f10484db-cd6f-4ccf-be5b-ff587821b87a req-1b06e381-99cb-4e19-81a8-06e1ee11fe2a service nova] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f10484db-cd6f-4ccf-be5b-ff587821b87a req-1b06e381-99cb-4e19-81a8-06e1ee11fe2a service nova] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:08 user nova-compute[73052]: DEBUG nova.network.neutron [req-f10484db-cd6f-4ccf-be5b-ff587821b87a req-1b06e381-99cb-4e19-81a8-06e1ee11fe2a service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing network info cache for port 3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:09 user nova-compute[73052]: DEBUG nova.network.neutron [req-f10484db-cd6f-4ccf-be5b-ff587821b87a req-1b06e381-99cb-4e19-81a8-06e1ee11fe2a service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully updated port: ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.network.neutron [req-f10484db-cd6f-4ccf-be5b-ff587821b87a req-1b06e381-99cb-4e19-81a8-06e1ee11fe2a service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f10484db-cd6f-4ccf-be5b-ff587821b87a req-1b06e381-99cb-4e19-81a8-06e1ee11fe2a service nova] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-1858cf0e-3761-46a9-bea1-9526dc492a6d req-a0a85f0d-a71d-48ab-b874-9adaf8ad67ff service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received event network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1858cf0e-3761-46a9-bea1-9526dc492a6d req-a0a85f0d-a71d-48ab-b874-9adaf8ad67ff service nova] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1858cf0e-3761-46a9-bea1-9526dc492a6d req-a0a85f0d-a71d-48ab-b874-9adaf8ad67ff service nova] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1858cf0e-3761-46a9-bea1-9526dc492a6d req-a0a85f0d-a71d-48ab-b874-9adaf8ad67ff service nova] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-1858cf0e-3761-46a9-bea1-9526dc492a6d req-a0a85f0d-a71d-48ab-b874-9adaf8ad67ff service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] No waiting events found dispatching network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:45:10 user nova-compute[73052]: WARNING nova.compute.manager [req-1858cf0e-3761-46a9-bea1-9526dc492a6d req-a0a85f0d-a71d-48ab-b874-9adaf8ad67ff service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received unexpected event network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 for instance with vm_state building and task_state spawning.
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-ae6ad877-2c93-470c-a0a3-ce39d8da1d6d req-14afb8b4-ec3b-43da-ae51-3a1fdc4c9706 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-changed-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-ae6ad877-2c93-470c-a0a3-ce39d8da1d6d req-14afb8b4-ec3b-43da-ae51-3a1fdc4c9706 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing instance network info cache due to event network-changed-ae26cb32-47d0-49d5-8be9-2ee917b6dd58. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ae6ad877-2c93-470c-a0a3-ce39d8da1d6d req-14afb8b4-ec3b-43da-ae51-3a1fdc4c9706 service nova] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ae6ad877-2c93-470c-a0a3-ce39d8da1d6d req-14afb8b4-ec3b-43da-ae51-3a1fdc4c9706 service nova] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:10 user nova-compute[73052]: DEBUG nova.network.neutron [req-ae6ad877-2c93-470c-a0a3-ce39d8da1d6d req-14afb8b4-ec3b-43da-ae51-3a1fdc4c9706 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing network info cache for port ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061111.0509195, 92558f0f-dc80-4acf-b3b9-27d0244c0ddb => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:45:11 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] VM Resumed (Lifecycle Event)
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.network.neutron [req-ae6ad877-2c93-470c-a0a3-ce39d8da1d6d req-14afb8b4-ec3b-43da-ae51-3a1fdc4c9706 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:11 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Instance spawned successfully.
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.352s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:11 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061111.0515215, 92558f0f-dc80-4acf-b3b9-27d0244c0ddb => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:45:11 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] VM Started (Lifecycle Event)
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.network.neutron [req-ae6ad877-2c93-470c-a0a3-ce39d8da1d6d req-14afb8b4-ec3b-43da-ae51-3a1fdc4c9706 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ae6ad877-2c93-470c-a0a3-ce39d8da1d6d req-14afb8b4-ec3b-43da-ae51-3a1fdc4c9706 service nova] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully updated port: dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:45:11 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:45:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.556s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:11 user nova-compute[73052]: INFO nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Took 8.45 seconds to spawn the instance on the hypervisor.
Aug 26 14:45:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:11 user nova-compute[73052]: INFO nova.compute.manager [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Took 9.81 seconds to build instance.
Aug 26 14:45:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dd72819e-4195-433d-8c90-1087893257de tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.027s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-9d5c906c-0ab9-4f8e-a16e-40593e6f4b8d req-9d653834-8b09-493c-96f5-44721f507435 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-changed-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-9d5c906c-0ab9-4f8e-a16e-40593e6f4b8d req-9d653834-8b09-493c-96f5-44721f507435 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing instance network info cache due to event network-changed-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9d5c906c-0ab9-4f8e-a16e-40593e6f4b8d req-9d653834-8b09-493c-96f5-44721f507435 service nova] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9d5c906c-0ab9-4f8e-a16e-40593e6f4b8d req-9d653834-8b09-493c-96f5-44721f507435 service nova] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG nova.network.neutron [req-9d5c906c-0ab9-4f8e-a16e-40593e6f4b8d req-9d653834-8b09-493c-96f5-44721f507435 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing network info cache for port dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG nova.network.neutron [req-9d5c906c-0ab9-4f8e-a16e-40593e6f4b8d req-9d653834-8b09-493c-96f5-44721f507435 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully updated port: 62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG nova.network.neutron [req-9d5c906c-0ab9-4f8e-a16e-40593e6f4b8d req-9d653834-8b09-493c-96f5-44721f507435 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9d5c906c-0ab9-4f8e-a16e-40593e6f4b8d req-9d653834-8b09-493c-96f5-44721f507435 service nova] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:15 user nova-compute[73052]: INFO nova.compute.manager [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Terminating instance
Aug 26 14:45:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-bf82c5fa-b0f9-4514-8afb-44c8f28d0d0a req-94237c63-3736-47f0-ad3c-0110ef3e1ed3 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-changed-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-bf82c5fa-b0f9-4514-8afb-44c8f28d0d0a req-94237c63-3736-47f0-ad3c-0110ef3e1ed3 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing instance network info cache due to event network-changed-62b21ac6-26c0-4ac2-8952-62e83a48124a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf82c5fa-b0f9-4514-8afb-44c8f28d0d0a req-94237c63-3736-47f0-ad3c-0110ef3e1ed3 service nova] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf82c5fa-b0f9-4514-8afb-44c8f28d0d0a req-94237c63-3736-47f0-ad3c-0110ef3e1ed3 service nova] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-bf82c5fa-b0f9-4514-8afb-44c8f28d0d0a req-94237c63-3736-47f0-ad3c-0110ef3e1ed3 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing network info cache for port 62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-bf82c5fa-b0f9-4514-8afb-44c8f28d0d0a req-94237c63-3736-47f0-ad3c-0110ef3e1ed3 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-bafb32b3-218e-424e-b372-1a1af06df578 req-0aca367d-a44e-413e-ac05-1976cc9cebef service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-unplugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bafb32b3-218e-424e-b372-1a1af06df578 req-0aca367d-a44e-413e-ac05-1976cc9cebef service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bafb32b3-218e-424e-b372-1a1af06df578 req-0aca367d-a44e-413e-ac05-1976cc9cebef service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bafb32b3-218e-424e-b372-1a1af06df578 req-0aca367d-a44e-413e-ac05-1976cc9cebef service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-bafb32b3-218e-424e-b372-1a1af06df578 req-0aca367d-a44e-413e-ac05-1976cc9cebef service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] No waiting events found dispatching network-vif-unplugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-bafb32b3-218e-424e-b372-1a1af06df578 req-0aca367d-a44e-413e-ac05-1976cc9cebef service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-unplugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:16 user nova-compute[73052]: DEBUG nova.network.neutron [req-bf82c5fa-b0f9-4514-8afb-44c8f28d0d0a req-94237c63-3736-47f0-ad3c-0110ef3e1ed3 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:45:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bf82c5fa-b0f9-4514-8afb-44c8f28d0d0a req-94237c63-3736-47f0-ad3c-0110ef3e1ed3 service nova] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully updated port: da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:17 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:45:17 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7647MB free_disk=25.590187072753906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:17 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Instance destroyed successfully.
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lazy-loading 'resources' on Instance uuid f0a01be4-94ff-4f2e-930f-a1e90b79abee {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1882452549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1009623059',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfBT9UGn/x6RhdSNVThc9709tWxKHd6uEPnsmjrMDl00UJ5WNxNYiqynxvWwjc21UlKvegnvwH1hbCsy0UqTdMc3LUYbgvkFLENhpgsRbhQCqJRHoVO3Cf5KM4QrR4hQ==',key_name='tempest-keypair-165596234',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:44:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23b4d9738fee4f0d8670371434d086e7',ramdisk_id='',reservation_id='r-nd0jgg04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-122650918',owner_user_name='tempest-ServerActionsV293TestJSON-122650918-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe3f4a562b249adb11042d070008e2c',uuid=f0a01be4-94ff-4f2e-930f-a1e90b79abee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converting VIF {"id": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "address": "fa:16:3e:c7:a2:46", "network": {"id": "da917565-fea5-49ce-8eb6-bef0e092b4e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-874425875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23b4d9738fee4f0d8670371434d086e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b4ca8a-8f", "ovs_interfaceid": "37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_vif [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37b4ca8a-8f, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:17 user nova-compute[73052]: INFO os_vif [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:a2:46,bridge_name='br-int',has_traffic_filtering=True,id=37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5,network=Network(da917565-fea5-49ce-8eb6-bef0e092b4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b4ca8a-8f')
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPtdKJSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:45:17 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[952285fc-9b7d-44b4-ba6f-f6d5dbd309e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: INFO nova.virt.block_device [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Booting with volume e0e2db4b-ebf1-4085-ace5-c0c14f445827 at /dev/vdb
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b223b4-8de2-46b1-a8e5-b573e66f4acb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:45:17 user nova-compute[73052]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)
Aug 26 14:45:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e (non-flash)
Aug 26 14:45:17 user nova-compute[73052]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)
Aug 26 14:45:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 79922a3f-53e3-4d29-8000-902e986e30c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance acb26430-b816-4969-b379-720e98cf59e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f0a01be4-94ff-4f2e-930f-a1e90b79abee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a0f34b07-88ee-4031-be68-73b57e1d2338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 74351d3b-b32d-4dc6-aaa3-25b11eadcabd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe60085-820a-4b83-b09d-8121797dbd65]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e4f518-ca1f-486a-ab12-d416be45aa63]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[39657e03-9f12-4f15-8519-d89bc3eefba9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.utils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[73125f27-f1c5-4367-bc9d-e58723931ac3]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c7f7d4-a84d-49df-ae62-7ab7d34780cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-306972ad-bce3-453d-a407-d157447e1029 req-a9fcf14a-c949-45f5-98b3-aa6a1a28590f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-changed-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-306972ad-bce3-453d-a407-d157447e1029 req-a9fcf14a-c949-45f5-98b3-aa6a1a28590f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing instance network info cache due to event network-changed-da95257c-a83b-41fe-b0c8-68859c558e24. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-306972ad-bce3-453d-a407-d157447e1029 req-a9fcf14a-c949-45f5-98b3-aa6a1a28590f service nova] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-306972ad-bce3-453d-a407-d157447e1029 req-a9fcf14a-c949-45f5-98b3-aa6a1a28590f service nova] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.network.neutron [req-306972ad-bce3-453d-a407-d157447e1029 req-a9fcf14a-c949-45f5-98b3-aa6a1a28590f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing network info cache for port da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f092b-4994-4473-933a-f0bde38da7bc]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e269e9d-8cec-4c78-9dca-32e088085a3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd67b9e-6b2b-4183-9313-e918793326e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f01de28-3734-4398-90e4-287ae283b8e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea11ab-5cea-47bf-bd7d-a21429170e0c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260]
Aug 26 14:45:17 user nova-compute[73052]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e, portal: 172.16.0.220,3260] successful.
Aug 26 14:45:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.network.neutron [req-306972ad-bce3-453d-a407-d157447e1029 req-a9fcf14a-c949-45f5-98b3-aa6a1a28590f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:45:17 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab6a19-4dd8-4e3f-a274-64216d500347]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.utils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== get_connector_properties: return (215ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating existing volume attachment record: 1ebccdad-6de7-428d-a1b8-8dd60fa250cc {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ef495a-6902-45c5-a8b6-195f586cb84e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3ebdec-6be9-4281-b925-5d7a07b0c8ab]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] <== disconnect_volume: return (453ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:45:17 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Deleting instance files /opt/stack/data/nova/instances/f0a01be4-94ff-4f2e-930f-a1e90b79abee_del
Aug 26 14:45:17 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Deletion of /opt/stack/data/nova/instances/f0a01be4-94ff-4f2e-930f-a1e90b79abee_del complete
Aug 26 14:45:17 user nova-compute[73052]: INFO nova.compute.manager [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Took 2.47 seconds to destroy the instance on the hypervisor.
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-3648136d-dbbc-4c0e-a849-90bb22d2cba9 req-c0932c61-4104-4973-a540-7ee2d9fd1568 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3648136d-dbbc-4c0e-a849-90bb22d2cba9 req-c0932c61-4104-4973-a540-7ee2d9fd1568 service nova] Acquiring lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3648136d-dbbc-4c0e-a849-90bb22d2cba9 req-c0932c61-4104-4973-a540-7ee2d9fd1568 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3648136d-dbbc-4c0e-a849-90bb22d2cba9 req-c0932c61-4104-4973-a540-7ee2d9fd1568 service nova] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-3648136d-dbbc-4c0e-a849-90bb22d2cba9 req-c0932c61-4104-4973-a540-7ee2d9fd1568 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] No waiting events found dispatching network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:45:17 user nova-compute[73052]: WARNING nova.compute.manager [req-3648136d-dbbc-4c0e-a849-90bb22d2cba9 req-c0932c61-4104-4973-a540-7ee2d9fd1568 service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received unexpected event network-vif-plugged-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 for instance with vm_state active and task_state deleting.
Aug 26 14:45:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:45:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.723s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:18 user nova-compute[73052]: DEBUG nova.network.neutron [req-306972ad-bce3-453d-a407-d157447e1029 req-a9fcf14a-c949-45f5-98b3-aa6a1a28590f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-306972ad-bce3-453d-a407-d157447e1029 req-a9fcf14a-c949-45f5-98b3-aa6a1a28590f service nova] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:19 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Took 1.34 seconds to deallocate network for instance.
Aug 26 14:45:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-e6d570b9-dd4d-4814-b572-2b8e2fe96ee4 req-43cafc79-f580-43e6-86a4-758e659c7a0c service nova] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Received event network-vif-deleted-37b4ca8a-8f57-4f54-8b85-8b86c98d1ab5 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully updated port: 3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-29f562b0-c50a-40dd-b10f-698785962299 req-0f075345-519e-4391-acac-e896aa540c0e service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-changed-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-29f562b0-c50a-40dd-b10f-698785962299 req-0f075345-519e-4391-acac-e896aa540c0e service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing instance network info cache due to event network-changed-3f406875-cb83-48ab-ab45-742bd5a50965. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-29f562b0-c50a-40dd-b10f-698785962299 req-0f075345-519e-4391-acac-e896aa540c0e service nova] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-29f562b0-c50a-40dd-b10f-698785962299 req-0f075345-519e-4391-acac-e896aa540c0e service nova] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG nova.network.neutron [req-29f562b0-c50a-40dd-b10f-698785962299 req-0f075345-519e-4391-acac-e896aa540c0e service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing network info cache for port 3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:19 user nova-compute[73052]: DEBUG nova.network.neutron [req-29f562b0-c50a-40dd-b10f-698785962299 req-0f075345-519e-4391-acac-e896aa540c0e service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:20 user nova-compute[73052]: INFO nova.compute.manager [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Took 0.98 seconds to detach 1 volumes for instance.
Aug 26 14:45:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Deleting volume: c3ef495a-6902-45c5-a8b6-195f586cb84e {{(pid=73052) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 14:45:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-29f562b0-c50a-40dd-b10f-698785962299 req-0f075345-519e-4391-acac-e896aa540c0e service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-29f562b0-c50a-40dd-b10f-698785962299 req-0f075345-519e-4391-acac-e896aa540c0e service nova] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:20 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:45:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:45:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:20 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Deleted allocations for instance f0a01be4-94ff-4f2e-930f-a1e90b79abee
Aug 26 14:45:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2fd81caf-1b2f-461d-abdc-47cbaefd1ade tempest-ServerActionsV293TestJSON-122650918 tempest-ServerActionsV293TestJSON-122650918-project-member] Lock "f0a01be4-94ff-4f2e-930f-a1e90b79abee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.662s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Successfully updated port: b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-d5919bc1-caec-40a9-a0f0-9d7b8002d26c req-d8442032-da6d-4bc6-bab1-7b2769387a06 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-changed-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-d5919bc1-caec-40a9-a0f0-9d7b8002d26c req-d8442032-da6d-4bc6-bab1-7b2769387a06 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing instance network info cache due to event network-changed-b0e95b3d-9f00-4995-bf49-24eec8b11fe9. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d5919bc1-caec-40a9-a0f0-9d7b8002d26c req-d8442032-da6d-4bc6-bab1-7b2769387a06 service nova] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:45:26 user nova-compute[73052]: INFO nova.compute.claims [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Claim successful on node user
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [{"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance network_info: |[{"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d5919bc1-caec-40a9-a0f0-9d7b8002d26c req-d8442032-da6d-4bc6-bab1-7b2769387a06 service nova] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.network.neutron [req-d5919bc1-caec-40a9-a0f0-9d7b8002d26c req-d8442032-da6d-4bc6-bab1-7b2769387a06 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing network info cache for port b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:45:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.policy [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f7c01b6be324d92bdb021b34d2c011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4564e9f65a9e4608a95bae156d64d4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:45:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Creating image(s)
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.265s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG nova.network.neutron [req-d5919bc1-caec-40a9-a0f0-9d7b8002d26c req-d8442032-da6d-4bc6-bab1-7b2769387a06 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updated VIF entry in instance network info cache for port b0e95b3d-9f00-4995-bf49-24eec8b11fe9. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG nova.network.neutron [req-d5919bc1-caec-40a9-a0f0-9d7b8002d26c req-d8442032-da6d-4bc6-bab1-7b2769387a06 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [{"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk 1073741824" returned: 0 in 0.068s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d5919bc1-caec-40a9-a0f0-9d7b8002d26c req-d8442032-da6d-4bc6-bab1-7b2769387a06 service nova] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Cannot resize image /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Ensure instance console log exists: /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Successfully created port: d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:45:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Successfully updated port: d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:45:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquired lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:45:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:45:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b5e68a11-71aa-4f44-8aa7-7bf31b7da2c5 req-06129c8d-bbb9-4b0c-b132-7e7e30add541 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-changed-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b5e68a11-71aa-4f44-8aa7-7bf31b7da2c5 req-06129c8d-bbb9-4b0c-b132-7e7e30add541 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Refreshing instance network info cache due to event network-changed-d5c81e0c-e3d2-42e3-a444-a1730b6d4763. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:45:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5e68a11-71aa-4f44-8aa7-7bf31b7da2c5 req-06129c8d-bbb9-4b0c-b132-7e7e30add541 service nova] Acquiring lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Releasing lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance network_info: |[{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5e68a11-71aa-4f44-8aa7-7bf31b7da2c5 req-06129c8d-bbb9-4b0c-b132-7e7e30add541 service nova] Acquired lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-b5e68a11-71aa-4f44-8aa7-7bf31b7da2c5 req-06129c8d-bbb9-4b0c-b132-7e7e30add541 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Refreshing network info cache for port d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Start _get_guest_xml network_info=[{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:45:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:45:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1978096229',display_name='tempest-ServerStableDeviceRescueTest-server-1978096229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1978096229',id=16,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYl6zJKbt43Fyr9FOe8j13+xH2QHq8Iaym6cf5iO5DFrk/ua4JwD+Mi7UoN3tw1MVSdsO76B0Oh178aC7MsQRIg3HANtZM5pUTjd26VfvXyzWyzzNYuZOnjhaOuN+Cww==',key_name='tempest-keypair-1722362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4564e9f65a9e4608a95bae156d64d4b0',ramdisk_id='',reservation_id='r-cfdfmddr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-848131570',owner_user_name='tempest-ServerStableDeviceRescueTest-848131570-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f7c01b6be324d92bdb021b34d2c011b',uuid=7e88d68a-33cf-467a-9e55-8162648a2b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Converting VIF {"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763,network=Network(d9ac1582-5175-4ca3-9ce2-0cc6451c5f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c81e0c-e3') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:45:29 user nova-compute[73052]:   <uuid>7e88d68a-33cf-467a-9e55-8162648a2b02</uuid>
Aug 26 14:45:29 user nova-compute[73052]:   <name>instance-00000010</name>
Aug 26 14:45:29 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:45:29 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:45:29 user nova-compute[73052]:   <metadata>
Aug 26 14:45:29 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:45:29 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:45:29 user nova-compute[73052]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1978096229</nova:name>
Aug 26 14:45:29 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:45:29</nova:creationTime>
Aug 26 14:45:29 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:45:29 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:45:29 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:45:29 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:45:29 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:45:29 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:45:29 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:45:29 user nova-compute[73052]:       <nova:owner>
Aug 26 14:45:29 user nova-compute[73052]:         <nova:user uuid="7f7c01b6be324d92bdb021b34d2c011b">tempest-ServerStableDeviceRescueTest-848131570-project-member</nova:user>
Aug 26 14:45:29 user nova-compute[73052]:         <nova:project uuid="4564e9f65a9e4608a95bae156d64d4b0">tempest-ServerStableDeviceRescueTest-848131570</nova:project>
Aug 26 14:45:29 user nova-compute[73052]:       </nova:owner>
Aug 26 14:45:29 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:45:29 user nova-compute[73052]:       <nova:ports>
Aug 26 14:45:29 user nova-compute[73052]:         <nova:port uuid="d5c81e0c-e3d2-42e3-a444-a1730b6d4763">
Aug 26 14:45:29 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 14:45:29 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:29 user nova-compute[73052]:       </nova:ports>
Aug 26 14:45:29 user nova-compute[73052]:     </nova:instance>
Aug 26 14:45:29 user nova-compute[73052]:   </metadata>
Aug 26 14:45:29 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:45:29 user nova-compute[73052]:     <system>
Aug 26 14:45:29 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:45:29 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:45:29 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:45:29 user nova-compute[73052]:       <entry name="serial">7e88d68a-33cf-467a-9e55-8162648a2b02</entry>
Aug 26 14:45:29 user nova-compute[73052]:       <entry name="uuid">7e88d68a-33cf-467a-9e55-8162648a2b02</entry>
Aug 26 14:45:29 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:45:29 user nova-compute[73052]:     </system>
Aug 26 14:45:29 user nova-compute[73052]:   </sysinfo>
Aug 26 14:45:29 user nova-compute[73052]:   <os>
Aug 26 14:45:29 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:45:29 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:45:29 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:45:29 user nova-compute[73052]:   </os>
Aug 26 14:45:29 user nova-compute[73052]:   <features>
Aug 26 14:45:29 user nova-compute[73052]:     <acpi/>
Aug 26 14:45:29 user nova-compute[73052]:     <apic/>
Aug 26 14:45:29 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:45:29 user nova-compute[73052]:   </features>
Aug 26 14:45:29 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:45:29 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:45:29 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:45:29 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:45:29 user nova-compute[73052]:   </clock>
Aug 26 14:45:29 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:45:29 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:45:29 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:45:29 user nova-compute[73052]:   </cpu>
Aug 26 14:45:29 user nova-compute[73052]:   <devices>
Aug 26 14:45:29 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:45:29 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:45:29 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk"/>
Aug 26 14:45:29 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:45:29 user nova-compute[73052]:     </disk>
Aug 26 14:45:29 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:29 user nova-compute[73052]:       <mac address="fa:16:3e:c1:d7:cd"/>
Aug 26 14:45:29 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:29 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:29 user nova-compute[73052]:       <target dev="tapd5c81e0c-e3"/>
Aug 26 14:45:29 user nova-compute[73052]:     </interface>
Aug 26 14:45:29 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:45:29 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/console.log" append="off"/>
Aug 26 14:45:29 user nova-compute[73052]:     </serial>
Aug 26 14:45:29 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:45:29 user nova-compute[73052]:     <video>
Aug 26 14:45:29 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:29 user nova-compute[73052]:     </video>
Aug 26 14:45:29 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:45:29 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:45:29 user nova-compute[73052]:     </rng>
Aug 26 14:45:29 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:45:29 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:45:29 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:45:29 user nova-compute[73052]:     </memballoon>
Aug 26 14:45:29 user nova-compute[73052]:   </devices>
Aug 26 14:45:29 user nova-compute[73052]: </domain>
Aug 26 14:45:29 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1978096229',display_name='tempest-ServerStableDeviceRescueTest-server-1978096229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1978096229',id=16,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYl6zJKbt43Fyr9FOe8j13+xH2QHq8Iaym6cf5iO5DFrk/ua4JwD+Mi7UoN3tw1MVSdsO76B0Oh178aC7MsQRIg3HANtZM5pUTjd26VfvXyzWyzzNYuZOnjhaOuN+Cww==',key_name='tempest-keypair-1722362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4564e9f65a9e4608a95bae156d64d4b0',ramdisk_id='',reservation_id='r-cfdfmddr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-848131570',owner_user_name='tempest-ServerStableDeviceRescueTest-848131570-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f7c01b6be324d92bdb021b34d2c011b',uuid=7e88d68a-33cf-467a-9e55-8162648a2b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Converting VIF {"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763,network=Network(d9ac1582-5175-4ca3-9ce2-0cc6451c5f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c81e0c-e3') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG os_vif [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763,network=Network(d9ac1582-5175-4ca3-9ce2-0cc6451c5f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c81e0c-e3') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5c81e0c-e3, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5c81e0c-e3, col_values=(('external_ids', {'iface-id': 'd5c81e0c-e3d2-42e3-a444-a1730b6d4763', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:d7:cd', 'vm-uuid': '7e88d68a-33cf-467a-9e55-8162648a2b02'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:29 user nova-compute[73052]: INFO os_vif [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763,network=Network(d9ac1582-5175-4ca3-9ce2-0cc6451c5f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c81e0c-e3')
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No VIF found with MAC fa:16:3e:c1:d7:cd, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-b5e68a11-71aa-4f44-8aa7-7bf31b7da2c5 req-06129c8d-bbb9-4b0c-b132-7e7e30add541 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updated VIF entry in instance network info cache for port d5c81e0c-e3d2-42e3-a444-a1730b6d4763. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-b5e68a11-71aa-4f44-8aa7-7bf31b7da2c5 req-06129c8d-bbb9-4b0c-b132-7e7e30add541 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5e68a11-71aa-4f44-8aa7-7bf31b7da2c5 req-06129c8d-bbb9-4b0c-b132-7e7e30add541 service nova] Releasing lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-6de8d4e7-a807-4b92-962e-403ab4662584 req-ee8e6231-b3ca-4538-aa15-1abd812f59a6 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6de8d4e7-a807-4b92-962e-403ab4662584 req-ee8e6231-b3ca-4538-aa15-1abd812f59a6 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6de8d4e7-a807-4b92-962e-403ab4662584 req-ee8e6231-b3ca-4538-aa15-1abd812f59a6 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6de8d4e7-a807-4b92-962e-403ab4662584 req-ee8e6231-b3ca-4538-aa15-1abd812f59a6 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-6de8d4e7-a807-4b92-962e-403ab4662584 req-ee8e6231-b3ca-4538-aa15-1abd812f59a6 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:45:31 user nova-compute[73052]: WARNING nova.compute.manager [req-6de8d4e7-a807-4b92-962e-403ab4662584 req-ee8e6231-b3ca-4538-aa15-1abd812f59a6 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state building and task_state spawning.
Aug 26 14:45:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:32 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061116.4747014, f0a01be4-94ff-4f2e-930f-a1e90b79abee => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:45:32 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] VM Stopped (Lifecycle Event)
Aug 26 14:45:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-05d9495f-257e-4e63-9b76-337f15559a18 None None] [instance: f0a01be4-94ff-4f2e-930f-a1e90b79abee] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:45:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-8fe48159-b37d-4707-a94c-e8354f70b2e5 req-7f9c99d4-e94c-45ff-acea-7b844afd71c5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8fe48159-b37d-4707-a94c-e8354f70b2e5 req-7f9c99d4-e94c-45ff-acea-7b844afd71c5 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8fe48159-b37d-4707-a94c-e8354f70b2e5 req-7f9c99d4-e94c-45ff-acea-7b844afd71c5 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8fe48159-b37d-4707-a94c-e8354f70b2e5 req-7f9c99d4-e94c-45ff-acea-7b844afd71c5 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-8fe48159-b37d-4707-a94c-e8354f70b2e5 req-7f9c99d4-e94c-45ff-acea-7b844afd71c5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:45:33 user nova-compute[73052]: WARNING nova.compute.manager [req-8fe48159-b37d-4707-a94c-e8354f70b2e5 req-7f9c99d4-e94c-45ff-acea-7b844afd71c5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state building and task_state spawning.
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061133.320517, 7e88d68a-33cf-467a-9e55-8162648a2b02 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:45:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] VM Resumed (Lifecycle Event)
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:45:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance spawned successfully.
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:45:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061133.3250344, 7e88d68a-33cf-467a-9e55-8162648a2b02 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:45:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] VM Started (Lifecycle Event)
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:45:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:45:33 user nova-compute[73052]: INFO nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Took 6.81 seconds to spawn the instance on the hypervisor.
Aug 26 14:45:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:45:34 user nova-compute[73052]: INFO nova.compute.manager [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Took 8.09 seconds to build instance.
Aug 26 14:45:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-dca9350b-986a-4dd1-87ce-cebfe5eeac40 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.221s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:37 user nova-compute[73052]: INFO nova.virt.block_device [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Booting with volume b032ce08-a760-4a53-8413-a914a45fc3e5 at /dev/vdc
Aug 26 14:45:37 user nova-compute[73052]: DEBUG os_brick.utils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afa7ad-521c-4f18-8c02-b1f1b2fd4dbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed6376e-4f44-4bc5-b55b-00a9a1bd5aba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e878f-f825-44b2-b5a5-2bb1b19f39b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35422b0-98bc-4330-ba05-11557473f6d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:45:37 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:45:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca03a9-645e-416a-b158-f9767a25d417]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG os_brick.utils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:45:37 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating existing volume attachment record: 7e96a390-747f-4102-9bc2-bbe90b4ef18d {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:45:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 14:45:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:49 user nova-compute[73052]: INFO nova.compute.manager [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Detaching volume 747d94fe-075a-427a-8a29-ff09feba9875
Aug 26 14:45:49 user nova-compute[73052]: INFO nova.virt.block_device [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Attempting to driver detach volume 747d94fe-075a-427a-8a29-ff09feba9875 from mountpoint /dev/vdc
Aug 26 14:45:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Attempting to detach device vdc from instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:45:50 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:45:50 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:45:50 user nova-compute[73052]:   <target dev="vdc" bus="virtio"/>
Aug 26 14:45:50 user nova-compute[73052]:   <serial>747d94fe-075a-427a-8a29-ff09feba9875</serial>
Aug 26 14:45:50 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 14:45:50 user nova-compute[73052]: </disk>
Aug 26 14:45:50 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:45:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully detached device vdc from instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c from the persistent domain config.
Aug 26 14:45:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:45:50 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:45:50 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:45:50 user nova-compute[73052]:   <target dev="vdc" bus="virtio"/>
Aug 26 14:45:50 user nova-compute[73052]:   <serial>747d94fe-075a-427a-8a29-ff09feba9875</serial>
Aug 26 14:45:50 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 14:45:50 user nova-compute[73052]: </disk>
Aug 26 14:45:50 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061150.6675513, 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:45:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully detached device vdc from instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c from the live domain config.
Aug 26 14:45:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDtoRHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:45:50 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6f027e-1332-45a2-b140-7ec2ac163954]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7416f87e-c611-407e-8877-cce6f235da30]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)
Aug 26 14:45:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 (non-flash)
Aug 26 14:45:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0188700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[761abbd7-3e91-4b52-80ff-4d252e3fc761]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca92c6-664b-41fa-9b13-4a50e6111331]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6611d8-26d4-444a-89b2-4bf4fa305979]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.071s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e00978d-23d6-4f35-8a1f-de2b4543eb15]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[43525666-b92f-4c7d-b063-1d6387a12d72]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[556a0241-ea9d-4d1d-a29e-d19f79d58b17]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875, portal: 172.16.0.220,3260]
Aug 26 14:45:51 user nova-compute[73052]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875, portal: 172.16.0.220,3260] successful.
Aug 26 14:45:51 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747d94fe-075a-427a-8a29-ff09feba9875 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8992670-f7db-4809-b008-ec2f17897616]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.475s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] <== disconnect_volume: return (478ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:45:51 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Creating image(s)
Aug 26 14:45:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Ensure instance console log exists: /opt/stack/data/nova/instances/74351d3b-b32d-4dc6-aaa3-25b11eadcabd/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.008s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Start _get_guest_xml network_info=[{"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'bebbbaf1-5dfd-4be3-9777-253d1a4ae1ea', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUJjOuMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd', 'attached_at': '', 'detached_at': '', 'volume_id': '4963a10b-980c-49ed-b597-c8cf6cc642c7', 'serial': '4963a10b-980c-49ed-b597-c8cf6cc642c7'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '1ebccdad-6de7-428d-a1b8-8dd60fa250cc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZulUpHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0e2db4b-ebf1-4085-ace5-c0c14f445827', 'serial': 'e0e2db4b-ebf1-4085-ace5-c0c14f445827'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '7e96a390-747f-4102-9bc2-bbe90b4ef18d', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFmxZrlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd', 'attached_at': '', 'detached_at': '', 'volume_id': 'b032ce08-a760-4a53-8413-a914a45fc3e5', 'serial': 'b032ce08-a760-4a53-8413-a914a45fc3e5'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:45:51 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:45:51 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:45:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:45:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUJjOuMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:45:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:45:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:45:52 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260" returned: 21 in 0.049s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc77255-398e-4784-904f-1b456ae7884d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:45:52 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bbb89d-cdc0-455c-99b1-4bc03de38515]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7] added
Aug 26 14:45:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a373e68-426a-4384-b020-b2ed49410085]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fae4df2-7bc0-4c67-83ae-229993b8af03]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUJjOuMh {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUJjOuMh" returned: 0 in 0.083s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a3584-16db-4351-a088-53538a1bdeb8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zUJjOuMh'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a4384a-a341-4e09-af04-e236a94deaff]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c8ed11-415b-4683-8d9e-7ff86efb700c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:45:52 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:45:52 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:45:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 14:45:52 user nova-compute[73052]: 
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'flavor' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bad156b-9921-47d6-9b9b-ff241e1f9d5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7, portal: 172.16.0.220,3260]
Aug 26 14:45:52 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7, portal: 172.16.0.220,3260] successful.
Aug 26 14:45:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-035d98b6-bb75-4fbd-8d0a-50fac1f69e41 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.591s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0747334-0ca2-42c5-b950-64516519d914]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f2cd0-1eaf-4f62-b893-58437e77d517]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[66443f3c-5840-40f8-9909-2808b4a80042]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:45:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUJjOuMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23739303338666664', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739303338666664', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZulUpHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:45:53 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:45:53 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:45:53 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8222ea14-6cdc-446e-ade2-4941ef665932]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:45:53 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3360be-17ff-4040-b518-76c433a7b87f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827] added
Aug 26 14:45:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48de32c-1161-4780-9b9b-1b8e8b6bc8c9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b7648c-3353-4afc-bdc1-8f9165f6c178]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PZulUpHq {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PZulUpHq" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e9fea9-0bc1-4ce7-b941-036d0e2c87bc]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PZulUpHq'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdf9365-2a13-4e2b-80a8-8fabb253b826]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cee8e4-744e-4e6c-81f1-9026618ccb8d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc71e1cb-07a7-48a9-b299-1132ab58e857]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827, portal: 172.16.0.220,3260]
Aug 26 14:45:53 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827, portal: 172.16.0.220,3260] successful.
Aug 26 14:45:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c98e82e-50b5-40e7-8a67-7a1308cf16c4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe56d4-ba6c-4caa-92d6-c3b8df1b1245]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:53 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:45:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:53 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:45:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a26186-5b02-48ef-8c11-d12017e599e3]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:45:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZulUpHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23262326338313636', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262326338313636', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFmxZrlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:45:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:45:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:45:54 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c0fb45-7290-41e6-ba00-11cdf050bd5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:45:54 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780924a-039b-4d03-a140-7752e2e25f48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5] added
Aug 26 14:45:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b17cf5-e5ab-4cf3-86ff-041f523e2baa]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc967b60-1fd8-443e-afdf-bd317bc9f9eb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dFmxZrlY {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dFmxZrlY" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f68cd9-907d-43b0-ba60-2631ece758f1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dFmxZrlY'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f79c470-5d93-41f7-94ca-3ba93d1e0739]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d527b44-8301-40b1-a3fa-84c45eb4c959]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d0775-cad1-426a-a190-e1dee34201c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5, portal: 172.16.0.220,3260]
Aug 26 14:45:55 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5, portal: 172.16.0.220,3260] successful.
Aug 26 14:45:55 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae031c4-defe-414d-9306-0aabc7caf4ec]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3078d9cf-8991-4a2d-905d-78fab68406d4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:45:55 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d59661a-e4e7-4bd1-baa6-e63decb363a3]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Skipping network cache update for instance because it is Building. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:45:55 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 79922a3f-53e3-4d29-8000-902e986e30c0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFmxZrlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23761633731303164', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761633731303164', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:40:29,bridge_name='br-int',has_traffic_filtering=True,id=3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7,network=Network(3e368788-00ca-4265-be3b-b13b8d6f754f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d358577-b2') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d2:d8,bridge_name='br-int',has_traffic_filtering=True,id=ae26cb32-47d0-49d5-8be9-2ee917b6dd58,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae26cb32-47') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:57:1a,bridge_name='br-int',has_traffic_filtering=True,id=dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdc3e96f7-dc') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f9:50,bridge_name='br-int',has_traffic_filtering=True,id=62b21ac6-26c0-4ac2-8952-62e83a48124a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62b21ac6-26') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=da95257c-a83b-41fe-b0c8-68859c558e24,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda95257c-a8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:9d:d0,bridge_name='br-int',has_traffic_filtering=True,id=3f406875-cb83-48ab-ab45-742bd5a50965,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f406875-cb') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:54:d5,bridge_name='br-int',has_traffic_filtering=True,id=b0e95b3d-9f00-4995-bf49-24eec8b11fe9,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0e95b3d-9f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.objects.instance [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lazy-loading 'pci_devices' on Instance uuid 74351d3b-b32d-4dc6-aaa3-25b11eadcabd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:45:56 user nova-compute[73052]:   <uuid>74351d3b-b32d-4dc6-aaa3-25b11eadcabd</uuid>
Aug 26 14:45:56 user nova-compute[73052]:   <name>instance-0000000e</name>
Aug 26 14:45:56 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:45:56 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:45:56 user nova-compute[73052]:   <metadata>
Aug 26 14:45:56 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:45:56 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:45:56 user nova-compute[73052]:       <nova:name>tempest-device-tagging-server-1127544310</nova:name>
Aug 26 14:45:56 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:45:51</nova:creationTime>
Aug 26 14:45:56 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:45:56 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:45:56 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:45:56 user nova-compute[73052]:       <nova:owner>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:user uuid="fba7e44b19654bf9b0532eb53725b1f0">tempest-TaggedBootDevicesTest_v242-1487698790-project-member</nova:user>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:project uuid="72fbf87994b3497c86c16c8ce605aaa2">tempest-TaggedBootDevicesTest_v242-1487698790</nova:project>
Aug 26 14:45:56 user nova-compute[73052]:       </nova:owner>
Aug 26 14:45:56 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:45:56 user nova-compute[73052]:       <nova:ports>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:port uuid="3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7">
Aug 26 14:45:56 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 14:45:56 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:port uuid="ae26cb32-47d0-49d5-8be9-2ee917b6dd58">
Aug 26 14:45:56 user nova-compute[73052]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Aug 26 14:45:56 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:port uuid="dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a">
Aug 26 14:45:56 user nova-compute[73052]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Aug 26 14:45:56 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:port uuid="62b21ac6-26c0-4ac2-8952-62e83a48124a">
Aug 26 14:45:56 user nova-compute[73052]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Aug 26 14:45:56 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:port uuid="da95257c-a83b-41fe-b0c8-68859c558e24">
Aug 26 14:45:56 user nova-compute[73052]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Aug 26 14:45:56 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:port uuid="3f406875-cb83-48ab-ab45-742bd5a50965">
Aug 26 14:45:56 user nova-compute[73052]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 14:45:56 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:56 user nova-compute[73052]:         <nova:port uuid="b0e95b3d-9f00-4995-bf49-24eec8b11fe9">
Aug 26 14:45:56 user nova-compute[73052]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 14:45:56 user nova-compute[73052]:         </nova:port>
Aug 26 14:45:56 user nova-compute[73052]:       </nova:ports>
Aug 26 14:45:56 user nova-compute[73052]:     </nova:instance>
Aug 26 14:45:56 user nova-compute[73052]:   </metadata>
Aug 26 14:45:56 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:45:56 user nova-compute[73052]:     <system>
Aug 26 14:45:56 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:45:56 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:45:56 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:45:56 user nova-compute[73052]:       <entry name="serial">74351d3b-b32d-4dc6-aaa3-25b11eadcabd</entry>
Aug 26 14:45:56 user nova-compute[73052]:       <entry name="uuid">74351d3b-b32d-4dc6-aaa3-25b11eadcabd</entry>
Aug 26 14:45:56 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:45:56 user nova-compute[73052]:     </system>
Aug 26 14:45:56 user nova-compute[73052]:   </sysinfo>
Aug 26 14:45:56 user nova-compute[73052]:   <os>
Aug 26 14:45:56 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:45:56 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:45:56 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:45:56 user nova-compute[73052]:   </os>
Aug 26 14:45:56 user nova-compute[73052]:   <features>
Aug 26 14:45:56 user nova-compute[73052]:     <acpi/>
Aug 26 14:45:56 user nova-compute[73052]:     <apic/>
Aug 26 14:45:56 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:45:56 user nova-compute[73052]:   </features>
Aug 26 14:45:56 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:45:56 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:45:56 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:45:56 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:45:56 user nova-compute[73052]:   </clock>
Aug 26 14:45:56 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:45:56 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:45:56 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:45:56 user nova-compute[73052]:   </cpu>
Aug 26 14:45:56 user nova-compute[73052]:   <devices>
Aug 26 14:45:56 user nova-compute[73052]:     <disk type="file" device="cdrom">
Aug 26 14:45:56 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 14:45:56 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/74351d3b-b32d-4dc6-aaa3-25b11eadcabd/disk.config"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="hda" bus="ide"/>
Aug 26 14:45:56 user nova-compute[73052]:     </disk>
Aug 26 14:45:56 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:45:56 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:45:56 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <serial>4963a10b-980c-49ed-b597-c8cf6cc642c7</serial>
Aug 26 14:45:56 user nova-compute[73052]:     </disk>
Aug 26 14:45:56 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:45:56 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:45:56 user nova-compute[73052]:       <source dev="/dev/sdc"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <serial>e0e2db4b-ebf1-4085-ace5-c0c14f445827</serial>
Aug 26 14:45:56 user nova-compute[73052]:     </disk>
Aug 26 14:45:56 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:45:56 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:45:56 user nova-compute[73052]:       <source dev="/dev/sdd"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="vdc" bus="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <serial>b032ce08-a760-4a53-8413-a914a45fc3e5</serial>
Aug 26 14:45:56 user nova-compute[73052]:     </disk>
Aug 26 14:45:56 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:56 user nova-compute[73052]:       <mac address="fa:16:3e:1d:40:29"/>
Aug 26 14:45:56 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="tap3d358577-b2"/>
Aug 26 14:45:56 user nova-compute[73052]:     </interface>
Aug 26 14:45:56 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:56 user nova-compute[73052]:       <mac address="fa:16:3e:e7:d2:d8"/>
Aug 26 14:45:56 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="tapae26cb32-47"/>
Aug 26 14:45:56 user nova-compute[73052]:     </interface>
Aug 26 14:45:56 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:56 user nova-compute[73052]:       <mac address="fa:16:3e:9a:57:1a"/>
Aug 26 14:45:56 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="tapdc3e96f7-dc"/>
Aug 26 14:45:56 user nova-compute[73052]:     </interface>
Aug 26 14:45:56 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:56 user nova-compute[73052]:       <mac address="fa:16:3e:3d:f9:50"/>
Aug 26 14:45:56 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="tap62b21ac6-26"/>
Aug 26 14:45:56 user nova-compute[73052]:     </interface>
Aug 26 14:45:56 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:56 user nova-compute[73052]:       <mac address="fa:16:3e:16:82:8e"/>
Aug 26 14:45:56 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="tapda95257c-a8"/>
Aug 26 14:45:56 user nova-compute[73052]:     </interface>
Aug 26 14:45:56 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:56 user nova-compute[73052]:       <mac address="fa:16:3e:2d:9d:d0"/>
Aug 26 14:45:56 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="tap3f406875-cb"/>
Aug 26 14:45:56 user nova-compute[73052]:     </interface>
Aug 26 14:45:56 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:45:56 user nova-compute[73052]:       <mac address="fa:16:3e:da:54:d5"/>
Aug 26 14:45:56 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:45:56 user nova-compute[73052]:       <target dev="tapb0e95b3d-9f"/>
Aug 26 14:45:56 user nova-compute[73052]:     </interface>
Aug 26 14:45:56 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:45:56 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/74351d3b-b32d-4dc6-aaa3-25b11eadcabd/console.log" append="off"/>
Aug 26 14:45:56 user nova-compute[73052]:     </serial>
Aug 26 14:45:56 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:45:56 user nova-compute[73052]:     <video>
Aug 26 14:45:56 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:45:56 user nova-compute[73052]:     </video>
Aug 26 14:45:56 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:45:56 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:45:56 user nova-compute[73052]:     </rng>
Aug 26 14:45:56 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:45:56 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:45:56 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:45:56 user nova-compute[73052]:     </memballoon>
Aug 26 14:45:56 user nova-compute[73052]:   </devices>
Aug 26 14:45:56 user nova-compute[73052]: </domain>
Aug 26 14:45:56 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:40:29,bridge_name='br-int',has_traffic_filtering=True,id=3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7,network=Network(3e368788-00ca-4265-be3b-b13b8d6f754f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d358577-b2') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:40:29,bridge_name='br-int',has_traffic_filtering=True,id=3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7,network=Network(3e368788-00ca-4265-be3b-b13b8d6f754f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d358577-b2') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d358577-b2, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d358577-b2, col_values=(('external_ids', {'iface-id': '3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:40:29', 'vm-uuid': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: INFO os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:40:29,bridge_name='br-int',has_traffic_filtering=True,id=3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7,network=Network(3e368788-00ca-4265-be3b-b13b8d6f754f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d358577-b2')
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d2:d8,bridge_name='br-int',has_traffic_filtering=True,id=ae26cb32-47d0-49d5-8be9-2ee917b6dd58,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae26cb32-47') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d2:d8,bridge_name='br-int',has_traffic_filtering=True,id=ae26cb32-47d0-49d5-8be9-2ee917b6dd58,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae26cb32-47') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae26cb32-47, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae26cb32-47, col_values=(('external_ids', {'iface-id': 'ae26cb32-47d0-49d5-8be9-2ee917b6dd58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:d2:d8', 'vm-uuid': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: INFO os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d2:d8,bridge_name='br-int',has_traffic_filtering=True,id=ae26cb32-47d0-49d5-8be9-2ee917b6dd58,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae26cb32-47')
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:57:1a,bridge_name='br-int',has_traffic_filtering=True,id=dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdc3e96f7-dc') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:57:1a,bridge_name='br-int',has_traffic_filtering=True,id=dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdc3e96f7-dc') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc3e96f7-dc, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc3e96f7-dc, col_values=(('external_ids', {'iface-id': 'dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:57:1a', 'vm-uuid': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: INFO os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:57:1a,bridge_name='br-int',has_traffic_filtering=True,id=dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdc3e96f7-dc')
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f9:50,bridge_name='br-int',has_traffic_filtering=True,id=62b21ac6-26c0-4ac2-8952-62e83a48124a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62b21ac6-26') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f9:50,bridge_name='br-int',has_traffic_filtering=True,id=62b21ac6-26c0-4ac2-8952-62e83a48124a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62b21ac6-26') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62b21ac6-26, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62b21ac6-26, col_values=(('external_ids', {'iface-id': '62b21ac6-26c0-4ac2-8952-62e83a48124a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:f9:50', 'vm-uuid': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: INFO os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f9:50,bridge_name='br-int',has_traffic_filtering=True,id=62b21ac6-26c0-4ac2-8952-62e83a48124a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62b21ac6-26')
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=da95257c-a83b-41fe-b0c8-68859c558e24,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda95257c-a8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=da95257c-a83b-41fe-b0c8-68859c558e24,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda95257c-a8') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda95257c-a8, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda95257c-a8, col_values=(('external_ids', {'iface-id': 'da95257c-a83b-41fe-b0c8-68859c558e24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:82:8e', 'vm-uuid': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: INFO os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=da95257c-a83b-41fe-b0c8-68859c558e24,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda95257c-a8')
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:9d:d0,bridge_name='br-int',has_traffic_filtering=True,id=3f406875-cb83-48ab-ab45-742bd5a50965,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f406875-cb') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:9d:d0,bridge_name='br-int',has_traffic_filtering=True,id=3f406875-cb83-48ab-ab45-742bd5a50965,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f406875-cb') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f406875-cb, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f406875-cb, col_values=(('external_ids', {'iface-id': '3f406875-cb83-48ab-ab45-742bd5a50965', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:9d:d0', 'vm-uuid': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: INFO os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:9d:d0,bridge_name='br-int',has_traffic_filtering=True,id=3f406875-cb83-48ab-ab45-742bd5a50965,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f406875-cb')
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:54:d5,bridge_name='br-int',has_traffic_filtering=True,id=b0e95b3d-9f00-4995-bf49-24eec8b11fe9,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0e95b3d-9f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:54:d5,bridge_name='br-int',has_traffic_filtering=True,id=b0e95b3d-9f00-4995-bf49-24eec8b11fe9,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0e95b3d-9f') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0e95b3d-9f, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0e95b3d-9f, col_values=(('external_ids', {'iface-id': 'b0e95b3d-9f00-4995-bf49-24eec8b11fe9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:54:d5', 'vm-uuid': '74351d3b-b32d-4dc6-aaa3-25b11eadcabd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:56 user nova-compute[73052]: INFO os_vif [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:54:d5,bridge_name='br-int',has_traffic_filtering=True,id=b0e95b3d-9f00-4995-bf49-24eec8b11fe9,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0e95b3d-9f')
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] No BDM found with device name hda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] No VIF found with MAC fa:16:3e:1d:40:29, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:45:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] No VIF found with MAC fa:16:3e:16:82:8e, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:45:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Using config drive
Aug 26 14:45:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Updating instance_info_cache with network_info: [{"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:45:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-79922a3f-53e3-4d29-8000-902e986e30c0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:45:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:45:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Creating config drive at /opt/stack/data/nova/instances/74351d3b-b32d-4dc6-aaa3-25b11eadcabd/disk.config
Aug 26 14:45:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/74351d3b-b32d-4dc6-aaa3-25b11eadcabd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcwz2g9u_ {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:45:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/74351d3b-b32d-4dc6-aaa3-25b11eadcabd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcwz2g9u_" returned: 0 in 0.069s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "a0f34b07-88ee-4031-be68-73b57e1d2338" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:45:58 user nova-compute[73052]: INFO nova.compute.manager [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Terminating instance
Aug 26 14:45:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:45:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:45:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Instance destroyed successfully.
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.objects.instance [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lazy-loading 'resources' on Instance uuid a0f34b07-88ee-4031-be68-73b57e1d2338 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1079271075',display_name='tempest-VolumesAdminNegativeTest-server-1079271075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1079271075',id=13,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:43:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6da93fd12c047348044fdc3eebd776d',ramdisk_id='',reservation_id='r-37a0tk47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1985528216',owner_user_name='tempest-VolumesAdminNegativeTest-1985528216-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:43:53Z,user_data=None,user_id='b571c97da94649df99b6b7c930b4b372',uuid=a0f34b07-88ee-4031-be68-73b57e1d2338,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converting VIF {"id": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "address": "fa:16:3e:bb:a3:2f", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f566-56", "ovs_interfaceid": "3910f566-565e-4f52-a3b9-0ecb6eb9ffbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=3910f566-565e-4f52-a3b9-0ecb6eb9ffbd,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f566-56') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG os_vif [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=3910f566-565e-4f52-a3b9-0ecb6eb9ffbd,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f566-56') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3910f566-56, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: INFO os_vif [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=3910f566-565e-4f52-a3b9-0ecb6eb9ffbd,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f566-56')
Aug 26 14:46:00 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Deleting instance files /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338_del
Aug 26 14:46:00 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Deletion of /opt/stack/data/nova/instances/a0f34b07-88ee-4031-be68-73b57e1d2338_del complete
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-9b8928e0-6931-4e4c-8e15-21f3dcb39b53 req-6413439b-7f5c-4be5-a203-82109f2948b4 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b8928e0-6931-4e4c-8e15-21f3dcb39b53 req-6413439b-7f5c-4be5-a203-82109f2948b4 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b8928e0-6931-4e4c-8e15-21f3dcb39b53 req-6413439b-7f5c-4be5-a203-82109f2948b4 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9b8928e0-6931-4e4c-8e15-21f3dcb39b53 req-6413439b-7f5c-4be5-a203-82109f2948b4 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-9b8928e0-6931-4e4c-8e15-21f3dcb39b53 req-6413439b-7f5c-4be5-a203-82109f2948b4 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:00 user nova-compute[73052]: WARNING nova.compute.manager [req-9b8928e0-6931-4e4c-8e15-21f3dcb39b53 req-6413439b-7f5c-4be5-a203-82109f2948b4 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 for instance with vm_state building and task_state spawning.
Aug 26 14:46:00 user nova-compute[73052]: INFO nova.compute.manager [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Took 1.74 seconds to destroy the instance on the hypervisor.
Aug 26 14:46:00 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:46:01 user nova-compute[73052]: INFO nova.compute.claims [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Claim successful on node user
Aug 26 14:46:01 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:01 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:02 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Took 1.72 seconds to deallocate network for instance.
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.902s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.compute.manager [req-5416b006-426e-4ce1-b099-810f13059072 req-00d3e02a-a34e-4d17-a4d9-a9c8429ebce6 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5416b006-426e-4ce1-b099-810f13059072 req-00d3e02a-a34e-4d17-a4d9-a9c8429ebce6 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5416b006-426e-4ce1-b099-810f13059072 req-00d3e02a-a34e-4d17-a4d9-a9c8429ebce6 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5416b006-426e-4ce1-b099-810f13059072 req-00d3e02a-a34e-4d17-a4d9-a9c8429ebce6 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.compute.manager [req-5416b006-426e-4ce1-b099-810f13059072 req-00d3e02a-a34e-4d17-a4d9-a9c8429ebce6 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:02 user nova-compute[73052]: WARNING nova.compute.manager [req-5416b006-426e-4ce1-b099-810f13059072 req-00d3e02a-a34e-4d17-a4d9-a9c8429ebce6 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 for instance with vm_state building and task_state spawning.
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.compute.manager [req-5416b006-426e-4ce1-b099-810f13059072 req-00d3e02a-a34e-4d17-a4d9-a9c8429ebce6 service nova] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Received event network-vif-deleted-3910f566-565e-4f52-a3b9-0ecb6eb9ffbd {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:02 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:46:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:46:03 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Creating image(s)
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG nova.policy [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb9db00a77d444f791cccb1be3d9150c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc99e80f5340d0ab8b4c7fe2d0a0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.401s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.266s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.891s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:03 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Deleted allocations for instance a0f34b07-88ee-4031-be68-73b57e1d2338
Aug 26 14:46:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.287s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-56331b48-4d0c-4c76-9aba-414bb45d3670 tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "a0f34b07-88ee-4031-be68-73b57e1d2338" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.788s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk 1073741824" returned: 0 in 0.071s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.402s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.252s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Cannot resize image /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Ensure instance console log exists: /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061164.4959078, 74351d3b-b32d-4dc6-aaa3-25b11eadcabd => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] VM Resumed (Lifecycle Event)
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:05 user nova-compute[73052]: WARNING nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 for instance with vm_state building and task_state spawning.
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:05 user nova-compute[73052]: WARNING nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 for instance with vm_state building and task_state spawning.
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:05 user nova-compute[73052]: WARNING nova.compute.manager [req-26cbc656-2952-4958-8018-bbcac3bedbf4 req-ea09fe33-8c99-4703-b4b1-f65175d9ea7f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a for instance with vm_state building and task_state spawning.
Aug 26 14:46:05 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance spawned successfully.
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061164.5992005, 74351d3b-b32d-4dc6-aaa3-25b11eadcabd => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] VM Started (Lifecycle Event)
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:46:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Successfully created port: fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-eaea87be-e3fe-4ac2-bcf3-c8f840516312 req-2bb908f8-a469-4ef2-877b-11bd8fd1d374 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eaea87be-e3fe-4ac2-bcf3-c8f840516312 req-2bb908f8-a469-4ef2-877b-11bd8fd1d374 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eaea87be-e3fe-4ac2-bcf3-c8f840516312 req-2bb908f8-a469-4ef2-877b-11bd8fd1d374 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eaea87be-e3fe-4ac2-bcf3-c8f840516312 req-2bb908f8-a469-4ef2-877b-11bd8fd1d374 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-eaea87be-e3fe-4ac2-bcf3-c8f840516312 req-2bb908f8-a469-4ef2-877b-11bd8fd1d374 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:05 user nova-compute[73052]: WARNING nova.compute.manager [req-eaea87be-e3fe-4ac2-bcf3-c8f840516312 req-2bb908f8-a469-4ef2-877b-11bd8fd1d374 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a for instance with vm_state building and task_state spawning.
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:05 user nova-compute[73052]: INFO nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Took 13.93 seconds to spawn the instance on the hypervisor.
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:05 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:46:05 user nova-compute[73052]: INFO nova.compute.claims [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Claim successful on node user
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:06 user nova-compute[73052]: INFO nova.compute.manager [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Took 66.26 seconds to build instance.
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6c72bdca-b739-40e5-9698-eb6a98145c8d tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 66.424s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.764s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:46:06 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:06 user nova-compute[73052]: WARNING nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a for instance with vm_state active and task_state None.
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:06 user nova-compute[73052]: WARNING nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 for instance with vm_state active and task_state None.
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:06 user nova-compute[73052]: WARNING nova.compute.manager [req-24b86907-6e65-471f-8b39-789d486271ec req-8479ed2d-2d07-4a42-a361-cdf1dc55e659 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 for instance with vm_state active and task_state None.
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:46:07 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Creating image(s)
Aug 26 14:46:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "/opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "/opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "/opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "5b1b92b9effb6e13bd78df4d3f579ed8dd778be1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "5b1b92b9effb6e13bd78df4d3f579ed8dd778be1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG nova.policy [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5477383284f46df97949c64f6cc0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7454d6d00cc4165b90d29aeea11067b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:08 user nova-compute[73052]: WARNING nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a for instance with vm_state active and task_state None.
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:08 user nova-compute[73052]: WARNING nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 for instance with vm_state active and task_state None.
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:08 user nova-compute[73052]: WARNING nova.compute.manager [req-6e79cc48-b5bc-4af9-9ee2-35ae58abec03 req-0505c7b1-4a9d-446d-9677-af97b5bff42f service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 for instance with vm_state active and task_state None.
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1.part --force-share --output=json" returned: 0 in 0.216s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.virt.images [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] 34627f75-187c-44f2-9749-4cc1345cfced was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1.part /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Successfully updated port: fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquired lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1.part /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1.converted" returned: 0 in 0.308s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Successfully created port: 4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:09 user nova-compute[73052]: WARNING nova.compute.manager [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 for instance with vm_state active and task_state None.
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:09 user nova-compute[73052]: WARNING nova.compute.manager [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 for instance with vm_state active and task_state None.
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-changed-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Refreshing instance network info cache due to event network-changed-fd15d9bd-b847-4224-8279-fa3bbb3958b9. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Acquiring lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1.converted --force-share --output=json" returned: 0 in 0.909s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "5b1b92b9effb6e13bd78df4d3f579ed8dd778be1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.314s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:46:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7476MB free_disk=25.545005798339844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 --force-share --output=json" returned: 0 in 0.211s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "5b1b92b9effb6e13bd78df4d3f579ed8dd778be1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "5b1b92b9effb6e13bd78df4d3f579ed8dd778be1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 79922a3f-53e3-4d29-8000-902e986e30c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance acb26430-b816-4969-b379-720e98cf59e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 74351d3b-b32d-4dc6-aaa3-25b11eadcabd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7e88d68a-33cf-467a-9e55-8162648a2b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c35499ba-06cb-443c-b019-5d3f9ea4c04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 --force-share --output=json" returned: 0 in 0.249s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1,backing_fmt=raw /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1,backing_fmt=raw /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk 1073741824" returned: 0 in 0.059s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "5b1b92b9effb6e13bd78df4d3f579ed8dd778be1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.723s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Cannot resize image /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Ensure instance console log exists: /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Successfully updated port: 4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquired lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-ab6aaa8d-f7fd-4e36-a44d-260ed21570c8 req-6cdd7e2d-8e9d-4bd8-b39c-f86a8b99fd89 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-ab6aaa8d-f7fd-4e36-a44d-260ed21570c8 req-6cdd7e2d-8e9d-4bd8-b39c-f86a8b99fd89 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing instance network info cache due to event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ab6aaa8d-f7fd-4e36-a44d-260ed21570c8 req-6cdd7e2d-8e9d-4bd8-b39c-f86a8b99fd89 service nova] Acquiring lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Releasing lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance network_info: |[{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Acquired lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.network.neutron [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Refreshing network info cache for port fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Start _get_guest_xml network_info=[{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:46:10 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:46:10 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:46:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating instance_info_cache with network_info: [{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:46:11 user nova-compute[73052]:   <uuid>3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</uuid>
Aug 26 14:46:11 user nova-compute[73052]:   <name>instance-00000011</name>
Aug 26 14:46:11 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:46:11 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:46:11 user nova-compute[73052]:   <metadata>
Aug 26 14:46:11 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:46:11 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:name>tempest-ServerActionsTestOtherB-server-900953138</nova:name>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:46:10</nova:creationTime>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:46:11 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:46:11 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:owner>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:user uuid="bb9db00a77d444f791cccb1be3d9150c">tempest-ServerActionsTestOtherB-135111462-project-member</nova:user>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:project uuid="9dbc99e80f5340d0ab8b4c7fe2d0a0c1">tempest-ServerActionsTestOtherB-135111462</nova:project>
Aug 26 14:46:11 user nova-compute[73052]:       </nova:owner>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:ports>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:port uuid="fd15d9bd-b847-4224-8279-fa3bbb3958b9">
Aug 26 14:46:11 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 14:46:11 user nova-compute[73052]:         </nova:port>
Aug 26 14:46:11 user nova-compute[73052]:       </nova:ports>
Aug 26 14:46:11 user nova-compute[73052]:     </nova:instance>
Aug 26 14:46:11 user nova-compute[73052]:   </metadata>
Aug 26 14:46:11 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:46:11 user nova-compute[73052]:     <system>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="serial">3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="uuid">3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:46:11 user nova-compute[73052]:     </system>
Aug 26 14:46:11 user nova-compute[73052]:   </sysinfo>
Aug 26 14:46:11 user nova-compute[73052]:   <os>
Aug 26 14:46:11 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:46:11 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:46:11 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:46:11 user nova-compute[73052]:   </os>
Aug 26 14:46:11 user nova-compute[73052]:   <features>
Aug 26 14:46:11 user nova-compute[73052]:     <acpi/>
Aug 26 14:46:11 user nova-compute[73052]:     <apic/>
Aug 26 14:46:11 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:46:11 user nova-compute[73052]:   </features>
Aug 26 14:46:11 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:46:11 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:46:11 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:46:11 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:46:11 user nova-compute[73052]:   </clock>
Aug 26 14:46:11 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:46:11 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:46:11 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:46:11 user nova-compute[73052]:   </cpu>
Aug 26 14:46:11 user nova-compute[73052]:   <devices>
Aug 26 14:46:11 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:46:11 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:46:11 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk"/>
Aug 26 14:46:11 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:46:11 user nova-compute[73052]:     </disk>
Aug 26 14:46:11 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:46:11 user nova-compute[73052]:       <mac address="fa:16:3e:5d:9d:ed"/>
Aug 26 14:46:11 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:46:11 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:46:11 user nova-compute[73052]:       <target dev="tapfd15d9bd-b8"/>
Aug 26 14:46:11 user nova-compute[73052]:     </interface>
Aug 26 14:46:11 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:46:11 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/console.log" append="off"/>
Aug 26 14:46:11 user nova-compute[73052]:     </serial>
Aug 26 14:46:11 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:46:11 user nova-compute[73052]:     <video>
Aug 26 14:46:11 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:46:11 user nova-compute[73052]:     </video>
Aug 26 14:46:11 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:46:11 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:46:11 user nova-compute[73052]:     </rng>
Aug 26 14:46:11 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:46:11 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:46:11 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:46:11 user nova-compute[73052]:     </memballoon>
Aug 26 14:46:11 user nova-compute[73052]:   </devices>
Aug 26 14:46:11 user nova-compute[73052]: </domain>
Aug 26 14:46:11 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG os_vif [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Releasing lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Instance network_info: |[{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ab6aaa8d-f7fd-4e36-a44d-260ed21570c8 req-6cdd7e2d-8e9d-4bd8-b39c-f86a8b99fd89 service nova] Acquired lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.neutron [req-ab6aaa8d-f7fd-4e36-a44d-260ed21570c8 req-6cdd7e2d-8e9d-4bd8-b39c-f86a8b99fd89 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Start _get_guest_xml network_info=[{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:45:59Z,direct_url=<?>,disk_format='qcow2',id=34627f75-187c-44f2-9749-4cc1345cfced,min_disk=0,min_ram=0,name='tempest-scenario-img--1444766556',owner='a7454d6d00cc4165b90d29aeea11067b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:46:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '34627f75-187c-44f2-9749-4cc1345cfced'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd15d9bd-b8, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd15d9bd-b8, col_values=(('external_ids', {'iface-id': 'fd15d9bd-b847-4224-8279-fa3bbb3958b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:9d:ed', 'vm-uuid': '3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:11 user nova-compute[73052]: INFO os_vif [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8')
Aug 26 14:46:11 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:46:11 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:45:59Z,direct_url=<?>,disk_format='qcow2',id=34627f75-187c-44f2-9749-4cc1345cfced,min_disk=0,min_ram=0,name='tempest-scenario-img--1444766556',owner='a7454d6d00cc4165b90d29aeea11067b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:46:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1176116480',display_name='tempest-TestMinimumBasicScenario-server-1176116480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1176116480',id=18,image_ref='34627f75-187c-44f2-9749-4cc1345cfced',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAMSIyDQ1VQy6BQTJ0WjR355nHpIHxZhWS7n7EqmhMZh7KAKhqSTSs8c0BrvxrQWpXyJiDHkm6unDULTP4wmzzGpXNR641qX59KqYrTwsK1Es0nLuwmp1AY4EAqHHQW7g==',key_name='tempest-TestMinimumBasicScenario-560329351',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-x02axkt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34627f75-187c-44f2-9749-4cc1345cfced',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:46:07Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=c35499ba-06cb-443c-b019-5d3f9ea4c04c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.objects.instance [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'pci_devices' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:46:11 user nova-compute[73052]:   <uuid>c35499ba-06cb-443c-b019-5d3f9ea4c04c</uuid>
Aug 26 14:46:11 user nova-compute[73052]:   <name>instance-00000012</name>
Aug 26 14:46:11 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:46:11 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:46:11 user nova-compute[73052]:   <metadata>
Aug 26 14:46:11 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:46:11 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:name>tempest-TestMinimumBasicScenario-server-1176116480</nova:name>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:46:11</nova:creationTime>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:46:11 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:46:11 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:owner>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:user uuid="c5477383284f46df97949c64f6cc0021">tempest-TestMinimumBasicScenario-1910985391-project-member</nova:user>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:project uuid="a7454d6d00cc4165b90d29aeea11067b">tempest-TestMinimumBasicScenario-1910985391</nova:project>
Aug 26 14:46:11 user nova-compute[73052]:       </nova:owner>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:root type="image" uuid="34627f75-187c-44f2-9749-4cc1345cfced"/>
Aug 26 14:46:11 user nova-compute[73052]:       <nova:ports>
Aug 26 14:46:11 user nova-compute[73052]:         <nova:port uuid="4db9d139-2df5-4482-9ff6-67939e0d9a32">
Aug 26 14:46:11 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 14:46:11 user nova-compute[73052]:         </nova:port>
Aug 26 14:46:11 user nova-compute[73052]:       </nova:ports>
Aug 26 14:46:11 user nova-compute[73052]:     </nova:instance>
Aug 26 14:46:11 user nova-compute[73052]:   </metadata>
Aug 26 14:46:11 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:46:11 user nova-compute[73052]:     <system>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="serial">c35499ba-06cb-443c-b019-5d3f9ea4c04c</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="uuid">c35499ba-06cb-443c-b019-5d3f9ea4c04c</entry>
Aug 26 14:46:11 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:46:11 user nova-compute[73052]:     </system>
Aug 26 14:46:11 user nova-compute[73052]:   </sysinfo>
Aug 26 14:46:11 user nova-compute[73052]:   <os>
Aug 26 14:46:11 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:46:11 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:46:11 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:46:11 user nova-compute[73052]:   </os>
Aug 26 14:46:11 user nova-compute[73052]:   <features>
Aug 26 14:46:11 user nova-compute[73052]:     <acpi/>
Aug 26 14:46:11 user nova-compute[73052]:     <apic/>
Aug 26 14:46:11 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:46:11 user nova-compute[73052]:   </features>
Aug 26 14:46:11 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:46:11 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:46:11 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:46:11 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:46:11 user nova-compute[73052]:   </clock>
Aug 26 14:46:11 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:46:11 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:46:11 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:46:11 user nova-compute[73052]:   </cpu>
Aug 26 14:46:11 user nova-compute[73052]:   <devices>
Aug 26 14:46:11 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:46:11 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:46:11 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk"/>
Aug 26 14:46:11 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:46:11 user nova-compute[73052]:     </disk>
Aug 26 14:46:11 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:46:11 user nova-compute[73052]:       <mac address="fa:16:3e:1f:a8:07"/>
Aug 26 14:46:11 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:46:11 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:46:11 user nova-compute[73052]:       <target dev="tap4db9d139-2d"/>
Aug 26 14:46:11 user nova-compute[73052]:     </interface>
Aug 26 14:46:11 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:46:11 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/console.log" append="off"/>
Aug 26 14:46:11 user nova-compute[73052]:     </serial>
Aug 26 14:46:11 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:46:11 user nova-compute[73052]:     <video>
Aug 26 14:46:11 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:46:11 user nova-compute[73052]:     </video>
Aug 26 14:46:11 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:46:11 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:46:11 user nova-compute[73052]:     </rng>
Aug 26 14:46:11 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:46:11 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:46:11 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:46:11 user nova-compute[73052]:     </memballoon>
Aug 26 14:46:11 user nova-compute[73052]:   </devices>
Aug 26 14:46:11 user nova-compute[73052]: </domain>
Aug 26 14:46:11 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1176116480',display_name='tempest-TestMinimumBasicScenario-server-1176116480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1176116480',id=18,image_ref='34627f75-187c-44f2-9749-4cc1345cfced',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAMSIyDQ1VQy6BQTJ0WjR355nHpIHxZhWS7n7EqmhMZh7KAKhqSTSs8c0BrvxrQWpXyJiDHkm6unDULTP4wmzzGpXNR641qX59KqYrTwsK1Es0nLuwmp1AY4EAqHHQW7g==',key_name='tempest-TestMinimumBasicScenario-560329351',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-x02axkt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34627f75-187c-44f2-9749-4cc1345cfced',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:46:07Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=c35499ba-06cb-443c-b019-5d3f9ea4c04c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG os_vif [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4db9d139-2d, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4db9d139-2d, col_values=(('external_ids', {'iface-id': '4db9d139-2df5-4482-9ff6-67939e0d9a32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:a8:07', 'vm-uuid': 'c35499ba-06cb-443c-b019-5d3f9ea4c04c'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] No VIF found with MAC fa:16:3e:5d:9d:ed, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:11 user nova-compute[73052]: INFO os_vif [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d')
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No VIF found with MAC fa:16:3e:1f:a8:07, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.neutron [req-ab6aaa8d-f7fd-4e36-a44d-260ed21570c8 req-6cdd7e2d-8e9d-4bd8-b39c-f86a8b99fd89 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updated VIF entry in instance network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG nova.network.neutron [req-ab6aaa8d-f7fd-4e36-a44d-260ed21570c8 req-6cdd7e2d-8e9d-4bd8-b39c-f86a8b99fd89 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating instance_info_cache with network_info: [{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ab6aaa8d-f7fd-4e36-a44d-260ed21570c8 req-6cdd7e2d-8e9d-4bd8-b39c-f86a8b99fd89 service nova] Releasing lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:12 user nova-compute[73052]: DEBUG nova.network.neutron [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updated VIF entry in instance network info cache for port fd15d9bd-b847-4224-8279-fa3bbb3958b9. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:46:12 user nova-compute[73052]: DEBUG nova.network.neutron [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e2a87b47-a973-488f-9eea-46389c19e786 req-638f6044-a11c-4b53-bad3-dd9398cee3af service nova] Releasing lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:46:14 user nova-compute[73052]: INFO nova.compute.claims [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Claim successful on node user
Aug 26 14:46:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-1bcdcdd6-4824-4c99-b3ba-61100a3c3fda req-27128144-172f-4ad9-ac8a-10bc022f5ad5 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1bcdcdd6-4824-4c99-b3ba-61100a3c3fda req-27128144-172f-4ad9-ac8a-10bc022f5ad5 service nova] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1bcdcdd6-4824-4c99-b3ba-61100a3c3fda req-27128144-172f-4ad9-ac8a-10bc022f5ad5 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1bcdcdd6-4824-4c99-b3ba-61100a3c3fda req-27128144-172f-4ad9-ac8a-10bc022f5ad5 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-1bcdcdd6-4824-4c99-b3ba-61100a3c3fda req-27128144-172f-4ad9-ac8a-10bc022f5ad5 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] No waiting events found dispatching network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:14 user nova-compute[73052]: WARNING nova.compute.manager [req-1bcdcdd6-4824-4c99-b3ba-61100a3c3fda req-27128144-172f-4ad9-ac8a-10bc022f5ad5 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received unexpected event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 for instance with vm_state building and task_state spawning.
Aug 26 14:46:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:46:14 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:46:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:46:15 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Creating image(s)
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "/opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "/opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "/opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG nova.policy [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa8d9ab665654f509c2a46d880620092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253c7bd7757f4c61a805538705b34087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061160.3301294, a0f34b07-88ee-4031-be68-73b57e1d2338 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:15 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] VM Stopped (Lifecycle Event)
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.238s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-db2fcd41-fba8-4a90-a50f-492cf1e9ce33 None None] [instance: a0f34b07-88ee-4031-be68-73b57e1d2338] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.259s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk 1073741824" returned: 0 in 0.123s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.388s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.223s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:46:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Successfully created port: e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Cannot resize image /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Ensure instance console log exists: /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] No waiting events found dispatching network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:16 user nova-compute[73052]: WARNING nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received unexpected event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 for instance with vm_state building and task_state spawning.
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:16 user nova-compute[73052]: WARNING nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state building and task_state spawning.
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:16 user nova-compute[73052]: WARNING nova.compute.manager [req-18e7bf85-2338-4b1f-b9ad-db8a890062f0 req-ee09a102-9192-4171-a83f-0a14202d216e service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state building and task_state spawning.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061177.0070922, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Resumed (Lifecycle Event)
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance spawned successfully.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Instance spawned successfully.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061177.007536, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Started (Lifecycle Event)
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061177.055747, c35499ba-06cb-443c-b019-5d3f9ea4c04c => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] VM Resumed (Lifecycle Event)
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Took 10.11 seconds to spawn the instance on the hypervisor.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Took 14.18 seconds to spawn the instance on the hypervisor.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061177.0564482, c35499ba-06cb-443c-b019-5d3f9ea4c04c => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] VM Started (Lifecycle Event)
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Took 16.07 seconds to build instance.
Aug 26 14:46:17 user nova-compute[73052]: INFO nova.compute.manager [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Took 11.50 seconds to build instance.
Aug 26 14:46:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2b3b07e2-b0a3-4e2c-b02f-14be1b130f87 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.341s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3d263923-dc79-4db2-917b-db1614a06384 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.757s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Successfully updated port: e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquired lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-05ce848a-ae95-468a-a0fd-13f060141ec2 req-20138b2f-086e-4882-a003-16a5f017edd7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received event network-changed-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-05ce848a-ae95-468a-a0fd-13f060141ec2 req-20138b2f-086e-4882-a003-16a5f017edd7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Refreshing instance network info cache due to event network-changed-e9280eae-40b0-4dbb-b31a-7499008b1cf9. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-05ce848a-ae95-468a-a0fd-13f060141ec2 req-20138b2f-086e-4882-a003-16a5f017edd7 service nova] Acquiring lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Updating instance_info_cache with network_info: [{"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Releasing lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Instance network_info: |[{"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-05ce848a-ae95-468a-a0fd-13f060141ec2 req-20138b2f-086e-4882-a003-16a5f017edd7 service nova] Acquired lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.network.neutron [req-05ce848a-ae95-468a-a0fd-13f060141ec2 req-20138b2f-086e-4882-a003-16a5f017edd7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Refreshing network info cache for port e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Start _get_guest_xml network_info=[{"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:46:18 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:46:18 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210334405',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210334405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210334',id=19,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBePImJQg9NCHRdLAXMk/RG38TYcpDmBnd/XudtRWf2OYdo7CFwUeSCXuEn88u3APtJlNat95ek2VM5aoELDYSXCFxrzb4i3MN+GOEQGo2qEdSrCJkjB83Yr2VQ+ffJ10g==',key_name='tempest-keypair-1368672479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='253c7bd7757f4c61a805538705b34087',ramdisk_id='',reservation_id='r-xtk9k44l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1368852551',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa8d9ab665654f509c2a46d880620092',uuid=86d43ddf-d653-4771-9d24-4c3617664337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Converting VIF {"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:18 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:8c:65,bridge_name='br-int',has_traffic_filtering=True,id=e9280eae-40b0-4dbb-b31a-7499008b1cf9,network=Network(5565c90f-5516-4a2e-afdd-0b56f58ae38c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9280eae-40') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lazy-loading 'pci_devices' on Instance uuid 86d43ddf-d653-4771-9d24-4c3617664337 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:46:19 user nova-compute[73052]:   <uuid>86d43ddf-d653-4771-9d24-4c3617664337</uuid>
Aug 26 14:46:19 user nova-compute[73052]:   <name>instance-00000013</name>
Aug 26 14:46:19 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:46:19 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:46:19 user nova-compute[73052]:   <metadata>
Aug 26 14:46:19 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:46:19 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:46:19 user nova-compute[73052]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1210334405</nova:name>
Aug 26 14:46:19 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:46:18</nova:creationTime>
Aug 26 14:46:19 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:46:19 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:46:19 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:46:19 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:46:19 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:46:19 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:46:19 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:46:19 user nova-compute[73052]:       <nova:owner>
Aug 26 14:46:19 user nova-compute[73052]:         <nova:user uuid="fa8d9ab665654f509c2a46d880620092">tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member</nova:user>
Aug 26 14:46:19 user nova-compute[73052]:         <nova:project uuid="253c7bd7757f4c61a805538705b34087">tempest-TestServerVolumeAttachScenarioOldVersion-1368852551</nova:project>
Aug 26 14:46:19 user nova-compute[73052]:       </nova:owner>
Aug 26 14:46:19 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:46:19 user nova-compute[73052]:       <nova:ports>
Aug 26 14:46:19 user nova-compute[73052]:         <nova:port uuid="e9280eae-40b0-4dbb-b31a-7499008b1cf9">
Aug 26 14:46:19 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 14:46:19 user nova-compute[73052]:         </nova:port>
Aug 26 14:46:19 user nova-compute[73052]:       </nova:ports>
Aug 26 14:46:19 user nova-compute[73052]:     </nova:instance>
Aug 26 14:46:19 user nova-compute[73052]:   </metadata>
Aug 26 14:46:19 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:46:19 user nova-compute[73052]:     <system>
Aug 26 14:46:19 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:46:19 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:46:19 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:46:19 user nova-compute[73052]:       <entry name="serial">86d43ddf-d653-4771-9d24-4c3617664337</entry>
Aug 26 14:46:19 user nova-compute[73052]:       <entry name="uuid">86d43ddf-d653-4771-9d24-4c3617664337</entry>
Aug 26 14:46:19 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:46:19 user nova-compute[73052]:     </system>
Aug 26 14:46:19 user nova-compute[73052]:   </sysinfo>
Aug 26 14:46:19 user nova-compute[73052]:   <os>
Aug 26 14:46:19 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:46:19 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:46:19 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:46:19 user nova-compute[73052]:   </os>
Aug 26 14:46:19 user nova-compute[73052]:   <features>
Aug 26 14:46:19 user nova-compute[73052]:     <acpi/>
Aug 26 14:46:19 user nova-compute[73052]:     <apic/>
Aug 26 14:46:19 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:46:19 user nova-compute[73052]:   </features>
Aug 26 14:46:19 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:46:19 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:46:19 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:46:19 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:46:19 user nova-compute[73052]:   </clock>
Aug 26 14:46:19 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:46:19 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:46:19 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:46:19 user nova-compute[73052]:   </cpu>
Aug 26 14:46:19 user nova-compute[73052]:   <devices>
Aug 26 14:46:19 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:46:19 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:46:19 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk"/>
Aug 26 14:46:19 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:46:19 user nova-compute[73052]:     </disk>
Aug 26 14:46:19 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:46:19 user nova-compute[73052]:       <mac address="fa:16:3e:ee:8c:65"/>
Aug 26 14:46:19 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:46:19 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:46:19 user nova-compute[73052]:       <target dev="tape9280eae-40"/>
Aug 26 14:46:19 user nova-compute[73052]:     </interface>
Aug 26 14:46:19 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:46:19 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/console.log" append="off"/>
Aug 26 14:46:19 user nova-compute[73052]:     </serial>
Aug 26 14:46:19 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:46:19 user nova-compute[73052]:     <video>
Aug 26 14:46:19 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:46:19 user nova-compute[73052]:     </video>
Aug 26 14:46:19 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:46:19 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:46:19 user nova-compute[73052]:     </rng>
Aug 26 14:46:19 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:46:19 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:46:19 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:46:19 user nova-compute[73052]:     </memballoon>
Aug 26 14:46:19 user nova-compute[73052]:   </devices>
Aug 26 14:46:19 user nova-compute[73052]: </domain>
Aug 26 14:46:19 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210334405',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210334405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210334',id=19,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBePImJQg9NCHRdLAXMk/RG38TYcpDmBnd/XudtRWf2OYdo7CFwUeSCXuEn88u3APtJlNat95ek2VM5aoELDYSXCFxrzb4i3MN+GOEQGo2qEdSrCJkjB83Yr2VQ+ffJ10g==',key_name='tempest-keypair-1368672479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='253c7bd7757f4c61a805538705b34087',ramdisk_id='',reservation_id='r-xtk9k44l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1368852551',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa8d9ab665654f509c2a46d880620092',uuid=86d43ddf-d653-4771-9d24-4c3617664337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Converting VIF {"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:8c:65,bridge_name='br-int',has_traffic_filtering=True,id=e9280eae-40b0-4dbb-b31a-7499008b1cf9,network=Network(5565c90f-5516-4a2e-afdd-0b56f58ae38c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9280eae-40') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG os_vif [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:8c:65,bridge_name='br-int',has_traffic_filtering=True,id=e9280eae-40b0-4dbb-b31a-7499008b1cf9,network=Network(5565c90f-5516-4a2e-afdd-0b56f58ae38c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9280eae-40') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9280eae-40, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9280eae-40, col_values=(('external_ids', {'iface-id': 'e9280eae-40b0-4dbb-b31a-7499008b1cf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:8c:65', 'vm-uuid': '86d43ddf-d653-4771-9d24-4c3617664337'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:19 user nova-compute[73052]: INFO os_vif [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:8c:65,bridge_name='br-int',has_traffic_filtering=True,id=e9280eae-40b0-4dbb-b31a-7499008b1cf9,network=Network(5565c90f-5516-4a2e-afdd-0b56f58ae38c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9280eae-40')
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] No VIF found with MAC fa:16:3e:ee:8c:65, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.network.neutron [req-05ce848a-ae95-468a-a0fd-13f060141ec2 req-20138b2f-086e-4882-a003-16a5f017edd7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Updated VIF entry in instance network info cache for port e9280eae-40b0-4dbb-b31a-7499008b1cf9. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG nova.network.neutron [req-05ce848a-ae95-468a-a0fd-13f060141ec2 req-20138b2f-086e-4882-a003-16a5f017edd7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Updating instance_info_cache with network_info: [{"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-05ce848a-ae95-468a-a0fd-13f060141ec2 req-20138b2f-086e-4882-a003-16a5f017edd7 service nova] Releasing lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-8c19e8ba-af73-4b3f-819d-3611a53739b0 req-6c165a02-bdf2-4c00-8235-d27e3daee90d service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received event network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8c19e8ba-af73-4b3f-819d-3611a53739b0 req-6c165a02-bdf2-4c00-8235-d27e3daee90d service nova] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8c19e8ba-af73-4b3f-819d-3611a53739b0 req-6c165a02-bdf2-4c00-8235-d27e3daee90d service nova] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8c19e8ba-af73-4b3f-819d-3611a53739b0 req-6c165a02-bdf2-4c00-8235-d27e3daee90d service nova] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-8c19e8ba-af73-4b3f-819d-3611a53739b0 req-6c165a02-bdf2-4c00-8235-d27e3daee90d service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] No waiting events found dispatching network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:21 user nova-compute[73052]: WARNING nova.compute.manager [req-8c19e8ba-af73-4b3f-819d-3611a53739b0 req-6c165a02-bdf2-4c00-8235-d27e3daee90d service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received unexpected event network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 for instance with vm_state building and task_state spawning.
Aug 26 14:46:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-e967044e-8e05-4e11-8ebe-6b7d77559c2a req-442bd058-d0f4-47ba-8765-26b9d6b414e7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received event network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e967044e-8e05-4e11-8ebe-6b7d77559c2a req-442bd058-d0f4-47ba-8765-26b9d6b414e7 service nova] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e967044e-8e05-4e11-8ebe-6b7d77559c2a req-442bd058-d0f4-47ba-8765-26b9d6b414e7 service nova] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e967044e-8e05-4e11-8ebe-6b7d77559c2a req-442bd058-d0f4-47ba-8765-26b9d6b414e7 service nova] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-e967044e-8e05-4e11-8ebe-6b7d77559c2a req-442bd058-d0f4-47ba-8765-26b9d6b414e7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] No waiting events found dispatching network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:23 user nova-compute[73052]: WARNING nova.compute.manager [req-e967044e-8e05-4e11-8ebe-6b7d77559c2a req-442bd058-d0f4-47ba-8765-26b9d6b414e7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received unexpected event network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 for instance with vm_state building and task_state spawning.
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061183.5893645, 86d43ddf-d653-4771-9d24-4c3617664337 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:23 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] VM Resumed (Lifecycle Event)
Aug 26 14:46:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Instance spawned successfully.
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:46:23 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061183.589632, 86d43ddf-d653-4771-9d24-4c3617664337 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:23 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] VM Started (Lifecycle Event)
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:23 user nova-compute[73052]: INFO nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Took 8.66 seconds to spawn the instance on the hypervisor.
Aug 26 14:46:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:23 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:46:23 user nova-compute[73052]: INFO nova.compute.manager [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Took 9.78 seconds to build instance.
Aug 26 14:46:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0f7af2c0-80fc-4d8c-9f93-278d6ade22f8 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.956s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:40 user nova-compute[73052]: INFO nova.compute.manager [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Terminating instance
Aug 26 14:46:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-b173a6a0-42d1-4f65-b735-0d381f130ee0 req-e9aff144-6a7f-4f8f-84f1-77b8197ec742 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-unplugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b173a6a0-42d1-4f65-b735-0d381f130ee0 req-e9aff144-6a7f-4f8f-84f1-77b8197ec742 service nova] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b173a6a0-42d1-4f65-b735-0d381f130ee0 req-e9aff144-6a7f-4f8f-84f1-77b8197ec742 service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b173a6a0-42d1-4f65-b735-0d381f130ee0 req-e9aff144-6a7f-4f8f-84f1-77b8197ec742 service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-b173a6a0-42d1-4f65-b735-0d381f130ee0 req-e9aff144-6a7f-4f8f-84f1-77b8197ec742 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] No waiting events found dispatching network-vif-unplugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-b173a6a0-42d1-4f65-b735-0d381f130ee0 req-e9aff144-6a7f-4f8f-84f1-77b8197ec742 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-unplugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:46:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Instance destroyed successfully.
Aug 26 14:46:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'resources' on Instance uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-488685255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-488685255',id=4,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3cf/nvxU1Q29x5etLTVRN/RQ0wT00lkZrqCUh0RYM7B4g67X/Lm72+DTghGliuZNzJ1HowMsSVP1RrPf2CC7oVhh1MBM7ZbVELfw80KWM8UIMDpmP/zDX6Kpg0pvIixg==',key_name='tempest-keypair-856206061',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-qy7djzrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=2e4f1fd3-d09f-4f6e-abda-9db2158eb46c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "address": "fa:16:3e:fb:18:36", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87904f2-9b", "ovs_interfaceid": "f87904f2-9bd7-46dd-a11b-4d870fbec13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG os_vif [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf87904f2-9b, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:41 user nova-compute[73052]: INFO os_vif [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:18:36,bridge_name='br-int',has_traffic_filtering=True,id=f87904f2-9bd7-46dd-a11b-4d870fbec13c,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87904f2-9b')
Aug 26 14:46:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Deleting instance files /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c_del
Aug 26 14:46:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Deletion of /opt/stack/data/nova/instances/2e4f1fd3-d09f-4f6e-abda-9db2158eb46c_del complete
Aug 26 14:46:41 user nova-compute[73052]: INFO nova.compute.manager [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 14:46:41 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:46:41 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:42 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Took 1.07 seconds to deallocate network for instance.
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:42 user nova-compute[73052]: WARNING nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 79922a3f-53e3-4d29-8000-902e986e30c0 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid acb26430-b816-4969-b379-720e98cf59e6 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 74351d3b-b32d-4dc6-aaa3-25b11eadcabd {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 86d43ddf-d653-4771-9d24-4c3617664337 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "79922a3f-53e3-4d29-8000-902e986e30c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "79922a3f-53e3-4d29-8000-902e986e30c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "eb6033f4-da59-4900-a67f-1e244631f046" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "acb26430-b816-4969-b379-720e98cf59e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "86d43ddf-d653-4771-9d24-4c3617664337" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-499d6cf2-2ea5-4a00-a161-4810f4b491f1 req-dc09e241-692f-4b8d-9461-3fdbee1300b4 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-499d6cf2-2ea5-4a00-a161-4810f4b491f1 req-dc09e241-692f-4b8d-9461-3fdbee1300b4 service nova] Acquiring lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-499d6cf2-2ea5-4a00-a161-4810f4b491f1 req-dc09e241-692f-4b8d-9461-3fdbee1300b4 service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-499d6cf2-2ea5-4a00-a161-4810f4b491f1 req-dc09e241-692f-4b8d-9461-3fdbee1300b4 service nova] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-499d6cf2-2ea5-4a00-a161-4810f4b491f1 req-dc09e241-692f-4b8d-9461-3fdbee1300b4 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] No waiting events found dispatching network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:42 user nova-compute[73052]: WARNING nova.compute.manager [req-499d6cf2-2ea5-4a00-a161-4810f4b491f1 req-dc09e241-692f-4b8d-9461-3fdbee1300b4 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received unexpected event network-vif-plugged-f87904f2-9bd7-46dd-a11b-4d870fbec13c for instance with vm_state deleted and task_state None.
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-499d6cf2-2ea5-4a00-a161-4810f4b491f1 req-dc09e241-692f-4b8d-9461-3fdbee1300b4 service nova] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Received event network-vif-deleted-f87904f2-9bd7-46dd-a11b-4d870fbec13c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:46:42 user nova-compute[73052]: WARNING oslo_messaging._drivers.amqpdriver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "eb6033f4-da59-4900-a67f-1e244631f046" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "79922a3f-53e3-4d29-8000-902e986e30c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "acb26430-b816-4969-b379-720e98cf59e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "86d43ddf-d653-4771-9d24-4c3617664337" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:46:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:42 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Deleted allocations for instance 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c
Aug 26 14:46:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7a04724f-de88-4a01-9eff-32abcdaf3688 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.295s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "2e4f1fd3-d09f-4f6e-abda-9db2158eb46c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:44 user nova-compute[73052]: INFO nova.compute.manager [None req-9434cf6f-b6ba-4f67-b4b3-450843883010 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Unrescuing
Aug 26 14:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9434cf6f-b6ba-4f67-b4b3-450843883010 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9434cf6f-b6ba-4f67-b4b3-450843883010 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquired lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:44 user nova-compute[73052]: DEBUG nova.network.neutron [None req-9434cf6f-b6ba-4f67-b4b3-450843883010 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG nova.network.neutron [None req-9434cf6f-b6ba-4f67-b4b3-450843883010 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9434cf6f-b6ba-4f67-b4b3-450843883010 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Releasing lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-9434cf6f-b6ba-4f67-b4b3-450843883010 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'flavor' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-09f9389d-751f-4a16-925d-393844cf2457 req-384b6331-c58d-4354-b1a8-c4a073cd2a79 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-09f9389d-751f-4a16-925d-393844cf2457 req-384b6331-c58d-4354-b1a8-c4a073cd2a79 service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-09f9389d-751f-4a16-925d-393844cf2457 req-384b6331-c58d-4354-b1a8-c4a073cd2a79 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-09f9389d-751f-4a16-925d-393844cf2457 req-384b6331-c58d-4354-b1a8-c4a073cd2a79 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-09f9389d-751f-4a16-925d-393844cf2457 req-384b6331-c58d-4354-b1a8-c4a073cd2a79 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:45 user nova-compute[73052]: WARNING nova.compute.manager [req-09f9389d-751f-4a16-925d-393844cf2457 req-384b6331-c58d-4354-b1a8-c4a073cd2a79 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:46:45 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance destroyed successfully.
Aug 26 14:46:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:47 user nova-compute[73052]: WARNING nova.compute.manager [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:46:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:47 user nova-compute[73052]: WARNING nova.compute.manager [req-f7850efd-3e52-45af-a3ac-d4917bd3e34c req-e7ca3a06-f94a-4386-b338-46c69d6b176f service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:46:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061209.537488, 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] VM Resumed (Lifecycle Event)
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9434cf6f-b6ba-4f67-b4b3-450843883010 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061209.5397656, 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] VM Started (Lifecycle Event)
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-d97ac30f-c8ad-4741-ba7b-f2d6e0618725 req-1683dbb3-195c-4210-a35c-afb90ef2fb41 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d97ac30f-c8ad-4741-ba7b-f2d6e0618725 req-1683dbb3-195c-4210-a35c-afb90ef2fb41 service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d97ac30f-c8ad-4741-ba7b-f2d6e0618725 req-1683dbb3-195c-4210-a35c-afb90ef2fb41 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d97ac30f-c8ad-4741-ba7b-f2d6e0618725 req-1683dbb3-195c-4210-a35c-afb90ef2fb41 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-d97ac30f-c8ad-4741-ba7b-f2d6e0618725 req-1683dbb3-195c-4210-a35c-afb90ef2fb41 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:49 user nova-compute[73052]: WARNING nova.compute.manager [req-d97ac30f-c8ad-4741-ba7b-f2d6e0618725 req-1683dbb3-195c-4210-a35c-afb90ef2fb41 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state active and task_state None.
Aug 26 14:46:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:46:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-b8b94348-dc4e-44c4-ae22-a4282bfa39c0 req-d21c172b-ab8e-4d1a-8dc9-c20fb7225dbc service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received event network-changed-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-b8b94348-dc4e-44c4-ae22-a4282bfa39c0 req-d21c172b-ab8e-4d1a-8dc9-c20fb7225dbc service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Refreshing instance network info cache due to event network-changed-8b6ce89f-520f-4036-82f8-aff1776d0b75. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:46:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8b94348-dc4e-44c4-ae22-a4282bfa39c0 req-d21c172b-ab8e-4d1a-8dc9-c20fb7225dbc service nova] Acquiring lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8b94348-dc4e-44c4-ae22-a4282bfa39c0 req-d21c172b-ab8e-4d1a-8dc9-c20fb7225dbc service nova] Acquired lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:54 user nova-compute[73052]: DEBUG nova.network.neutron [req-b8b94348-dc4e-44c4-ae22-a4282bfa39c0 req-d21c172b-ab8e-4d1a-8dc9-c20fb7225dbc service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Refreshing network info cache for port 8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:46:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:55 user nova-compute[73052]: DEBUG nova.network.neutron [req-b8b94348-dc4e-44c4-ae22-a4282bfa39c0 req-d21c172b-ab8e-4d1a-8dc9-c20fb7225dbc service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updated VIF entry in instance network info cache for port 8b6ce89f-520f-4036-82f8-aff1776d0b75. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:46:55 user nova-compute[73052]: DEBUG nova.network.neutron [req-b8b94348-dc4e-44c4-ae22-a4282bfa39c0 req-d21c172b-ab8e-4d1a-8dc9-c20fb7225dbc service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating instance_info_cache with network_info: [{"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8b94348-dc4e-44c4-ae22-a4282bfa39c0 req-d21c172b-ab8e-4d1a-8dc9-c20fb7225dbc service nova] Releasing lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:46:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:46:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:46:55 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:46:56 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061201.0244727, 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:46:56 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] VM Stopped (Lifecycle Event)
Aug 26 14:46:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0af2d058-2af0-4091-aacc-c31fda08026f None None] [instance: 2e4f1fd3-d09f-4f6e-abda-9db2158eb46c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:46:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:56 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:46:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:46:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:46:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:58 user nova-compute[73052]: INFO nova.compute.manager [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Terminating instance
Aug 26 14:46:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-cafcc53d-2351-44bc-9260-78c50d0ba1cd req-a3e46107-0c66-41a2-8d36-0737a695be25 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received event network-vif-unplugged-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cafcc53d-2351-44bc-9260-78c50d0ba1cd req-a3e46107-0c66-41a2-8d36-0737a695be25 service nova] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cafcc53d-2351-44bc-9260-78c50d0ba1cd req-a3e46107-0c66-41a2-8d36-0737a695be25 service nova] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cafcc53d-2351-44bc-9260-78c50d0ba1cd req-a3e46107-0c66-41a2-8d36-0737a695be25 service nova] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-cafcc53d-2351-44bc-9260-78c50d0ba1cd req-a3e46107-0c66-41a2-8d36-0737a695be25 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] No waiting events found dispatching network-vif-unplugged-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-cafcc53d-2351-44bc-9260-78c50d0ba1cd req-a3e46107-0c66-41a2-8d36-0737a695be25 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received event network-vif-unplugged-12ae594b-302d-483b-8832-eb05dae17537 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:46:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: acb26430-b816-4969-b379-720e98cf59e6] Instance destroyed successfully.
Aug 26 14:46:58 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lazy-loading 'resources' on Instance uuid acb26430-b816-4969-b379-720e98cf59e6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2045442147',display_name='tempest-VolumesAdminNegativeTest-server-2045442147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2045442147',id=5,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtbmrmD+VKYCcZjo87SbJEBrUxDUn9Sv+M5TAiSDPaDMUC1bqfQuZa7l9zw+3LpAM/yFcMZoK5hTvAwGrjrVDP4FOySTkB5fF3C/RviWSwX7Xo66s+xMCJZ+8U7HHWeQw==',key_name='tempest-keypair-362619017',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6da93fd12c047348044fdc3eebd776d',ramdisk_id='',reservation_id='r-mzkj8lp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1985528216',owner_user_name='tempest-VolumesAdminNegativeTest-1985528216-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b571c97da94649df99b6b7c930b4b372',uuid=acb26430-b816-4969-b379-720e98cf59e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converting VIF {"id": "12ae594b-302d-483b-8832-eb05dae17537", "address": "fa:16:3e:11:3b:26", "network": {"id": "2e51d3dd-b896-46d4-b5bd-2e0162817d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2115322049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6da93fd12c047348044fdc3eebd776d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ae594b-30", "ovs_interfaceid": "12ae594b-302d-483b-8832-eb05dae17537", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:3b:26,bridge_name='br-int',has_traffic_filtering=True,id=12ae594b-302d-483b-8832-eb05dae17537,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ae594b-30') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG os_vif [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:3b:26,bridge_name='br-int',has_traffic_filtering=True,id=12ae594b-302d-483b-8832-eb05dae17537,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ae594b-30') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12ae594b-30, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:46:58 user nova-compute[73052]: INFO os_vif [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:3b:26,bridge_name='br-int',has_traffic_filtering=True,id=12ae594b-302d-483b-8832-eb05dae17537,network=Network(2e51d3dd-b896-46d4-b5bd-2e0162817d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ae594b-30')
Aug 26 14:46:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Deleting instance files /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6_del
Aug 26 14:46:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Deletion of /opt/stack/data/nova/instances/acb26430-b816-4969-b379-720e98cf59e6_del complete
Aug 26 14:46:59 user nova-compute[73052]: INFO nova.compute.manager [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] [instance: acb26430-b816-4969-b379-720e98cf59e6] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 14:46:59 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:46:59 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: acb26430-b816-4969-b379-720e98cf59e6] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:46:59 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: acb26430-b816-4969-b379-720e98cf59e6] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:46:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: acb26430-b816-4969-b379-720e98cf59e6] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:00 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: acb26430-b816-4969-b379-720e98cf59e6] Took 1.25 seconds to deallocate network for instance.
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-7ccea6ca-4928-49b0-9b4c-361461f72a3c req-a3e79b47-4a21-48f2-93aa-cb3cd3bc8e0a service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received event network-vif-deleted-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-565fdd01-defd-4984-a7a7-f78c9039ef55 req-59629476-70bf-460a-a80b-576ef8d7d542 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received event network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-565fdd01-defd-4984-a7a7-f78c9039ef55 req-59629476-70bf-460a-a80b-576ef8d7d542 service nova] Acquiring lock "acb26430-b816-4969-b379-720e98cf59e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-565fdd01-defd-4984-a7a7-f78c9039ef55 req-59629476-70bf-460a-a80b-576ef8d7d542 service nova] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-565fdd01-defd-4984-a7a7-f78c9039ef55 req-59629476-70bf-460a-a80b-576ef8d7d542 service nova] Lock "acb26430-b816-4969-b379-720e98cf59e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-565fdd01-defd-4984-a7a7-f78c9039ef55 req-59629476-70bf-460a-a80b-576ef8d7d542 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] No waiting events found dispatching network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:00 user nova-compute[73052]: WARNING nova.compute.manager [req-565fdd01-defd-4984-a7a7-f78c9039ef55 req-59629476-70bf-460a-a80b-576ef8d7d542 service nova] [instance: acb26430-b816-4969-b379-720e98cf59e6] Received unexpected event network-vif-plugged-12ae594b-302d-483b-8832-eb05dae17537 for instance with vm_state deleted and task_state None.
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:00 user nova-compute[73052]: INFO nova.compute.manager [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attaching volume 0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 to /dev/vdb
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG os_brick.utils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[62be4f30-0180-463d-bd5f-ed7c229c4fe4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:00 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Deleted allocations for instance acb26430-b816-4969-b379-720e98cf59e6
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c69fe4-7ea0-4d90-9d0e-61d40e96e12a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c829e1e-e492-4b92-a066-9ddb3c1ac0ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c812bdac-bf03-429c-8ddc-1e16e240b163]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:47:00 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb7246-4063-4cad-a4a7-0b0dfadd0325]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG os_brick.utils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating existing volume attachment record: d0375dff-6952-46ed-bb20-8b548387701a {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e53805c3-689c-44d5-a3c9-476018a144db tempest-VolumesAdminNegativeTest-1985528216 tempest-VolumesAdminNegativeTest-1985528216-project-member] Lock "acb26430-b816-4969-b379-720e98cf59e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.805s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:05 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:47:05 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7175MB free_disk=25.42475128173828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 79922a3f-53e3-4d29-8000-902e986e30c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 74351d3b-b32d-4dc6-aaa3-25b11eadcabd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7e88d68a-33cf-467a-9e55-8162648a2b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c35499ba-06cb-443c-b019-5d3f9ea4c04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 86d43ddf-d653-4771-9d24-4c3617664337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:47:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:47:06 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:47:06 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:47:06 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:47:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:13 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061218.950594, acb26430-b816-4969-b379-720e98cf59e6 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:47:13 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: acb26430-b816-4969-b379-720e98cf59e6] VM Stopped (Lifecycle Event)
Aug 26 14:47:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-aaaac99a-038f-4967-88e0-6377d9a04c3e None None] [instance: acb26430-b816-4969-b379-720e98cf59e6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:47:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWHoUcsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:47:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:47:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:47:16 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3085bda2-625b-4298-bbc1-92f949a17eff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:47:16 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[400632c7-a282-4643-b530-78e8ab0a8b4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99] added
Aug 26 14:47:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b51c52-3e6d-45c9-9b76-65b0c27a2a0c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb29736c-43f1-43d7-82b0-d52ee02c82c3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aWHoUcsp {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aWHoUcsp" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[859ea229-9da5-404c-9d52-48fbc4500803]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aWHoUcsp'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee14868-834b-4c17-ae7e-6c1ca3a8650e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e79d54-5f92-47e4-bdfd-3aa009543744]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:47:16 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:47:16 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:47:16 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:47:16 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1bb563-239a-42d3-be00-edbe50399066]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99, portal: 172.16.0.220,3260]
Aug 26 14:47:16 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99, portal: 172.16.0.220,3260] successful.
Aug 26 14:47:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[99351040-4c55-4cbe-9755-f9d3f9625b0e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4211e7f1-d633-4583-b02e-e86551760b0e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:47:17 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:47:17 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:17 user nova-compute[73052]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:47:17 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:47:17 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:17 user nova-compute[73052]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-59ab14ea-76f6-4af4-a0de-d5b315482fe4 req-fb8d2e5b-9278-4a11-8b85-d884aad10d44 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-changed-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-59ab14ea-76f6-4af4-a0de-d5b315482fe4 req-fb8d2e5b-9278-4a11-8b85-d884aad10d44 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Refreshing instance network info cache due to event network-changed-d5c81e0c-e3d2-42e3-a444-a1730b6d4763. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-59ab14ea-76f6-4af4-a0de-d5b315482fe4 req-fb8d2e5b-9278-4a11-8b85-d884aad10d44 service nova] Acquiring lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-59ab14ea-76f6-4af4-a0de-d5b315482fe4 req-fb8d2e5b-9278-4a11-8b85-d884aad10d44 service nova] Acquired lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG nova.network.neutron [req-59ab14ea-76f6-4af4-a0de-d5b315482fe4 req-fb8d2e5b-9278-4a11-8b85-d884aad10d44 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Refreshing network info cache for port d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26f66be-6b1e-40ae-a113-f9d254a4e84c]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG nova.network.neutron [req-59ab14ea-76f6-4af4-a0de-d5b315482fe4 req-fb8d2e5b-9278-4a11-8b85-d884aad10d44 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updated VIF entry in instance network info cache for port d5c81e0c-e3d2-42e3-a444-a1730b6d4763. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG nova.network.neutron [req-59ab14ea-76f6-4af4-a0de-d5b315482fe4 req-fb8d2e5b-9278-4a11-8b85-d884aad10d44 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-59ab14ea-76f6-4af4-a0de-d5b315482fe4 req-fb8d2e5b-9278-4a11-8b85-d884aad10d44 service nova] Releasing lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWHoUcsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23935316264623865', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935316264623865', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:47:18 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:47:18 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:47:18 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:47:18 user nova-compute[73052]:   <serial>0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99</serial>
Aug 26 14:47:18 user nova-compute[73052]: </disk>
Aug 26 14:47:18 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:47:18 user nova-compute[73052]: INFO nova.compute.manager [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] instance snapshotting
Aug 26 14:47:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Beginning live snapshot process
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json -f qcow2 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No VIF found with MAC fa:16:3e:51:e9:f0, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json -f qcow2 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e71625d7-68ff-4e6e-8a55-ea609f2275ee tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.918s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.171s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe2ncyin1/aad144c4e40243e9a5c61f0a2c3757b7.delta 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe2ncyin1/aad144c4e40243e9a5c61f0a2c3757b7.delta 1073741824" returned: 0 in 0.057s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 14:47:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:47:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:47:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 14:47:20 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:47:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe2ncyin1/aad144c4e40243e9a5c61f0a2c3757b7.delta /opt/stack/data/nova/instances/snapshots/tmpe2ncyin1/aad144c4e40243e9a5c61f0a2c3757b7 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe2ncyin1/aad144c4e40243e9a5c61f0a2c3757b7.delta /opt/stack/data/nova/instances/snapshots/tmpe2ncyin1/aad144c4e40243e9a5c61f0a2c3757b7" returned: 0 in 0.561s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Snapshot extracted, beginning image upload
Aug 26 14:47:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Snapshot image upload complete
Aug 26 14:47:23 user nova-compute[73052]: INFO nova.compute.manager [None req-cd4cd78f-b0b2-4c4d-8021-1ca8487c2ef0 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Took 5.13 seconds to snapshot the instance on the hypervisor.
Aug 26 14:47:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:47:35 user nova-compute[73052]: INFO nova.compute.claims [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Claim successful on node user
Aug 26 14:47:35 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:47:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:47:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:47:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG nova.policy [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2513642eea3411b9c8c33714bd2f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267e3757f3624d869a2e5e3d31376b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:47:36 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Creating image(s)
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.215s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk 1073741824" returned: 0 in 0.063s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.226s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Successfully created port: 25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:47:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:37 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Cannot resize image /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:47:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:47:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Ensure instance console log exists: /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:47:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Successfully updated port: 25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquired lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-017cb8fa-cf20-4da7-9486-3d98d85f8bde req-705037f7-ff01-4be1-b241-f8fe5ffc9e95 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-changed-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-017cb8fa-cf20-4da7-9486-3d98d85f8bde req-705037f7-ff01-4be1-b241-f8fe5ffc9e95 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Refreshing instance network info cache due to event network-changed-25613dee-a11d-49c8-aeba-808b01197e7a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-017cb8fa-cf20-4da7-9486-3d98d85f8bde req-705037f7-ff01-4be1-b241-f8fe5ffc9e95 service nova] Acquiring lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:47:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating instance_info_cache with network_info: [{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Releasing lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance network_info: |[{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-017cb8fa-cf20-4da7-9486-3d98d85f8bde req-705037f7-ff01-4be1-b241-f8fe5ffc9e95 service nova] Acquired lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-017cb8fa-cf20-4da7-9486-3d98d85f8bde req-705037f7-ff01-4be1-b241-f8fe5ffc9e95 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Refreshing network info cache for port 25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Start _get_guest_xml network_info=[{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:47:39 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:47:39 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-974097995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-974097995',id=20,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxkGTZIwhwifi3AWxYsd1u+oJMT8+InAe7LUzawcAt5ZVVe6ftgimyrZAKb0Dc7pG5Q2DKzybFjs3hwqYCtXQJiZGbrheLePJ6Q6iK9gnk0vPOJbjPbxoF3B7JweqYXbQ==',key_name='tempest-keypair-746986181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-bawqgpzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:47:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=83e00d7a-c0a0-4e39-af7c-c2fb9a564406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'pci_devices' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:47:39 user nova-compute[73052]:   <uuid>83e00d7a-c0a0-4e39-af7c-c2fb9a564406</uuid>
Aug 26 14:47:39 user nova-compute[73052]:   <name>instance-00000014</name>
Aug 26 14:47:39 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:47:39 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:47:39 user nova-compute[73052]:   <metadata>
Aug 26 14:47:39 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:47:39 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:47:39 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-974097995</nova:name>
Aug 26 14:47:39 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:47:39</nova:creationTime>
Aug 26 14:47:39 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:47:39 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:47:39 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:47:39 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:47:39 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:47:39 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:47:39 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:47:39 user nova-compute[73052]:       <nova:owner>
Aug 26 14:47:39 user nova-compute[73052]:         <nova:user uuid="e2513642eea3411b9c8c33714bd2f3b3">tempest-AttachVolumeShelveTestJSON-1914851903-project-member</nova:user>
Aug 26 14:47:39 user nova-compute[73052]:         <nova:project uuid="267e3757f3624d869a2e5e3d31376b5c">tempest-AttachVolumeShelveTestJSON-1914851903</nova:project>
Aug 26 14:47:39 user nova-compute[73052]:       </nova:owner>
Aug 26 14:47:39 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:47:39 user nova-compute[73052]:       <nova:ports>
Aug 26 14:47:39 user nova-compute[73052]:         <nova:port uuid="25613dee-a11d-49c8-aeba-808b01197e7a">
Aug 26 14:47:39 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 14:47:39 user nova-compute[73052]:         </nova:port>
Aug 26 14:47:39 user nova-compute[73052]:       </nova:ports>
Aug 26 14:47:39 user nova-compute[73052]:     </nova:instance>
Aug 26 14:47:39 user nova-compute[73052]:   </metadata>
Aug 26 14:47:39 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:47:39 user nova-compute[73052]:     <system>
Aug 26 14:47:39 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:47:39 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:47:39 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:47:39 user nova-compute[73052]:       <entry name="serial">83e00d7a-c0a0-4e39-af7c-c2fb9a564406</entry>
Aug 26 14:47:39 user nova-compute[73052]:       <entry name="uuid">83e00d7a-c0a0-4e39-af7c-c2fb9a564406</entry>
Aug 26 14:47:39 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:47:39 user nova-compute[73052]:     </system>
Aug 26 14:47:39 user nova-compute[73052]:   </sysinfo>
Aug 26 14:47:39 user nova-compute[73052]:   <os>
Aug 26 14:47:39 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:47:39 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:47:39 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:47:39 user nova-compute[73052]:   </os>
Aug 26 14:47:39 user nova-compute[73052]:   <features>
Aug 26 14:47:39 user nova-compute[73052]:     <acpi/>
Aug 26 14:47:39 user nova-compute[73052]:     <apic/>
Aug 26 14:47:39 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:47:39 user nova-compute[73052]:   </features>
Aug 26 14:47:39 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:47:39 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:47:39 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:47:39 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:47:39 user nova-compute[73052]:   </clock>
Aug 26 14:47:39 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:47:39 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:47:39 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:47:39 user nova-compute[73052]:   </cpu>
Aug 26 14:47:39 user nova-compute[73052]:   <devices>
Aug 26 14:47:39 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:47:39 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:47:39 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk"/>
Aug 26 14:47:39 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:47:39 user nova-compute[73052]:     </disk>
Aug 26 14:47:39 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:47:39 user nova-compute[73052]:       <mac address="fa:16:3e:a7:bd:76"/>
Aug 26 14:47:39 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:47:39 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:47:39 user nova-compute[73052]:       <target dev="tap25613dee-a1"/>
Aug 26 14:47:39 user nova-compute[73052]:     </interface>
Aug 26 14:47:39 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:47:39 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/console.log" append="off"/>
Aug 26 14:47:39 user nova-compute[73052]:     </serial>
Aug 26 14:47:39 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:47:39 user nova-compute[73052]:     <video>
Aug 26 14:47:39 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:47:39 user nova-compute[73052]:     </video>
Aug 26 14:47:39 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:47:39 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:47:39 user nova-compute[73052]:     </rng>
Aug 26 14:47:39 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:47:39 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:47:39 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:47:39 user nova-compute[73052]:     </memballoon>
Aug 26 14:47:39 user nova-compute[73052]:   </devices>
Aug 26 14:47:39 user nova-compute[73052]: </domain>
Aug 26 14:47:39 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-974097995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-974097995',id=20,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxkGTZIwhwifi3AWxYsd1u+oJMT8+InAe7LUzawcAt5ZVVe6ftgimyrZAKb0Dc7pG5Q2DKzybFjs3hwqYCtXQJiZGbrheLePJ6Q6iK9gnk0vPOJbjPbxoF3B7JweqYXbQ==',key_name='tempest-keypair-746986181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-bawqgpzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:47:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=83e00d7a-c0a0-4e39-af7c-c2fb9a564406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG os_vif [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25613dee-a1, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25613dee-a1, col_values=(('external_ids', {'iface-id': '25613dee-a11d-49c8-aeba-808b01197e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:bd:76', 'vm-uuid': '83e00d7a-c0a0-4e39-af7c-c2fb9a564406'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:39 user nova-compute[73052]: INFO os_vif [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1')
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No VIF found with MAC fa:16:3e:a7:bd:76, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-017cb8fa-cf20-4da7-9486-3d98d85f8bde req-705037f7-ff01-4be1-b241-f8fe5ffc9e95 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updated VIF entry in instance network info cache for port 25613dee-a11d-49c8-aeba-808b01197e7a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-017cb8fa-cf20-4da7-9486-3d98d85f8bde req-705037f7-ff01-4be1-b241-f8fe5ffc9e95 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating instance_info_cache with network_info: [{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-017cb8fa-cf20-4da7-9486-3d98d85f8bde req-705037f7-ff01-4be1-b241-f8fe5ffc9e95 service nova] Releasing lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:47:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-925c337a-5819-4663-a3c6-57bc41746466 req-bc112c30-52fe-4335-a7d2-9a97d7e9552b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-925c337a-5819-4663-a3c6-57bc41746466 req-bc112c30-52fe-4335-a7d2-9a97d7e9552b service nova] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-925c337a-5819-4663-a3c6-57bc41746466 req-bc112c30-52fe-4335-a7d2-9a97d7e9552b service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-925c337a-5819-4663-a3c6-57bc41746466 req-bc112c30-52fe-4335-a7d2-9a97d7e9552b service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-925c337a-5819-4663-a3c6-57bc41746466 req-bc112c30-52fe-4335-a7d2-9a97d7e9552b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] No waiting events found dispatching network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:41 user nova-compute[73052]: WARNING nova.compute.manager [req-925c337a-5819-4663-a3c6-57bc41746466 req-bc112c30-52fe-4335-a7d2-9a97d7e9552b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received unexpected event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a for instance with vm_state building and task_state spawning.
Aug 26 14:47:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-be6b5cca-04dd-4bcd-8f99-413839ad8d88 req-46fcd2f1-e404-4d4c-979e-380d766a8949 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-changed-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-be6b5cca-04dd-4bcd-8f99-413839ad8d88 req-46fcd2f1-e404-4d4c-979e-380d766a8949 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing instance network info cache due to event network-changed-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:47:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-be6b5cca-04dd-4bcd-8f99-413839ad8d88 req-46fcd2f1-e404-4d4c-979e-380d766a8949 service nova] Acquiring lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:47:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-be6b5cca-04dd-4bcd-8f99-413839ad8d88 req-46fcd2f1-e404-4d4c-979e-380d766a8949 service nova] Acquired lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:47:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-be6b5cca-04dd-4bcd-8f99-413839ad8d88 req-46fcd2f1-e404-4d4c-979e-380d766a8949 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Refreshing network info cache for port 3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:47:42 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061262.9845386, 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:47:42 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] VM Resumed (Lifecycle Event)
Aug 26 14:47:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:47:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:47:42 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance spawned successfully.
Aug 26 14:47:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:47:43 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061262.9919884, 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:47:43 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] VM Started (Lifecycle Event)
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:47:43 user nova-compute[73052]: INFO nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Took 6.93 seconds to spawn the instance on the hypervisor.
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:47:43 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:47:43 user nova-compute[73052]: INFO nova.compute.manager [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Took 7.86 seconds to build instance.
Aug 26 14:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e3cd850d-857d-432a-9c05-0419067694f3 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-ddaa0219-b16f-4585-9b47-24f4b6faac9f req-f2ef5824-5e96-4f68-9dd6-2b9af0ee76f2 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ddaa0219-b16f-4585-9b47-24f4b6faac9f req-f2ef5824-5e96-4f68-9dd6-2b9af0ee76f2 service nova] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ddaa0219-b16f-4585-9b47-24f4b6faac9f req-f2ef5824-5e96-4f68-9dd6-2b9af0ee76f2 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ddaa0219-b16f-4585-9b47-24f4b6faac9f req-f2ef5824-5e96-4f68-9dd6-2b9af0ee76f2 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-ddaa0219-b16f-4585-9b47-24f4b6faac9f req-f2ef5824-5e96-4f68-9dd6-2b9af0ee76f2 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] No waiting events found dispatching network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:43 user nova-compute[73052]: WARNING nova.compute.manager [req-ddaa0219-b16f-4585-9b47-24f4b6faac9f req-f2ef5824-5e96-4f68-9dd6-2b9af0ee76f2 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received unexpected event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a for instance with vm_state active and task_state None.
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-be6b5cca-04dd-4bcd-8f99-413839ad8d88 req-46fcd2f1-e404-4d4c-979e-380d766a8949 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updated VIF entry in instance network info cache for port 3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-be6b5cca-04dd-4bcd-8f99-413839ad8d88 req-46fcd2f1-e404-4d4c-979e-380d766a8949 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [{"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-be6b5cca-04dd-4bcd-8f99-413839ad8d88 req-46fcd2f1-e404-4d4c-979e-380d766a8949 service nova] Releasing lock "refresh_cache-74351d3b-b32d-4dc6-aaa3-25b11eadcabd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:47:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:46 user nova-compute[73052]: INFO nova.compute.manager [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Terminating instance
Aug 26 14:47:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-e9d8f235-1daf-4678-83ea-184d88cfda00 req-4b193a8a-c206-4d90-bf9b-0030d6fd56ad service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e9d8f235-1daf-4678-83ea-184d88cfda00 req-4b193a8a-c206-4d90-bf9b-0030d6fd56ad service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e9d8f235-1daf-4678-83ea-184d88cfda00 req-4b193a8a-c206-4d90-bf9b-0030d6fd56ad service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e9d8f235-1daf-4678-83ea-184d88cfda00 req-4b193a8a-c206-4d90-bf9b-0030d6fd56ad service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-e9d8f235-1daf-4678-83ea-184d88cfda00 req-4b193a8a-c206-4d90-bf9b-0030d6fd56ad service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-unplugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-e9d8f235-1daf-4678-83ea-184d88cfda00 req-4b193a8a-c206-4d90-bf9b-0030d6fd56ad service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Instance destroyed successfully.
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.objects.instance [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lazy-loading 'resources' on Instance uuid 74351d3b-b32d-4dc6-aaa3-25b11eadcabd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:40:29,bridge_name='br-int',has_traffic_filtering=True,id=3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7,network=Network(3e368788-00ca-4265-be3b-b13b8d6f754f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d358577-b2') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:40:29,bridge_name='br-int',has_traffic_filtering=True,id=3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7,network=Network(3e368788-00ca-4265-be3b-b13b8d6f754f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d358577-b2') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d358577-b2, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: INFO os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:40:29,bridge_name='br-int',has_traffic_filtering=True,id=3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7,network=Network(3e368788-00ca-4265-be3b-b13b8d6f754f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d358577-b2')
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d2:d8,bridge_name='br-int',has_traffic_filtering=True,id=ae26cb32-47d0-49d5-8be9-2ee917b6dd58,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae26cb32-47') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d2:d8,bridge_name='br-int',has_traffic_filtering=True,id=ae26cb32-47d0-49d5-8be9-2ee917b6dd58,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae26cb32-47') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae26cb32-47, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: INFO os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d2:d8,bridge_name='br-int',has_traffic_filtering=True,id=ae26cb32-47d0-49d5-8be9-2ee917b6dd58,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae26cb32-47')
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:57:1a,bridge_name='br-int',has_traffic_filtering=True,id=dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdc3e96f7-dc') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:57:1a,bridge_name='br-int',has_traffic_filtering=True,id=dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdc3e96f7-dc') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc3e96f7-dc, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: INFO os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:57:1a,bridge_name='br-int',has_traffic_filtering=True,id=dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdc3e96f7-dc')
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "address": "fa:16:3e:3d:f9:50", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62b21ac6-26", "ovs_interfaceid": "62b21ac6-26c0-4ac2-8952-62e83a48124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f9:50,bridge_name='br-int',has_traffic_filtering=True,id=62b21ac6-26c0-4ac2-8952-62e83a48124a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62b21ac6-26') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f9:50,bridge_name='br-int',has_traffic_filtering=True,id=62b21ac6-26c0-4ac2-8952-62e83a48124a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62b21ac6-26') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62b21ac6-26, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: INFO os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f9:50,bridge_name='br-int',has_traffic_filtering=True,id=62b21ac6-26c0-4ac2-8952-62e83a48124a,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62b21ac6-26')
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=da95257c-a83b-41fe-b0c8-68859c558e24,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda95257c-a8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=da95257c-a83b-41fe-b0c8-68859c558e24,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda95257c-a8') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda95257c-a8, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: INFO os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=da95257c-a83b-41fe-b0c8-68859c558e24,network=Network(d1a0d087-dc89-4f5e-8900-2faaf816ae88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda95257c-a8')
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:9d:d0,bridge_name='br-int',has_traffic_filtering=True,id=3f406875-cb83-48ab-ab45-742bd5a50965,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f406875-cb') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:9d:d0,bridge_name='br-int',has_traffic_filtering=True,id=3f406875-cb83-48ab-ab45-742bd5a50965,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f406875-cb') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f406875-cb, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: INFO os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:9d:d0,bridge_name='br-int',has_traffic_filtering=True,id=3f406875-cb83-48ab-ab45-742bd5a50965,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f406875-cb')
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127544310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127544310',id=14,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIUEzkdn/SZkfuD5jilQjgOqUkP/qhp3lWgCRtEEBWiFgXUA9Q+1C93RZd5gPoS9DXfVwJJSRSY7vcpSoejT6aUCiAnHBgv0x5PDxIdmz+SR3f6NzJxa3rjBZ7Da1TTTA==',key_name='tempest-keypair-548595322',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fbf87994b3497c86c16c8ce605aaa2',ramdisk_id='',reservation_id='r-00gjhnzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1487698790',owner_user_name='tempest-TaggedBootDevicesTest_v242-1487698790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba7e44b19654bf9b0532eb53725b1f0',uuid=74351d3b-b32d-4dc6-aaa3-25b11eadcabd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converting VIF {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:54:d5,bridge_name='br-int',has_traffic_filtering=True,id=b0e95b3d-9f00-4995-bf49-24eec8b11fe9,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0e95b3d-9f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:54:d5,bridge_name='br-int',has_traffic_filtering=True,id=b0e95b3d-9f00-4995-bf49-24eec8b11fe9,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0e95b3d-9f') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0e95b3d-9f, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:47:48 user nova-compute[73052]: INFO os_vif [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:54:d5,bridge_name='br-int',has_traffic_filtering=True,id=b0e95b3d-9f00-4995-bf49-24eec8b11fe9,network=Network(4d0dd8d0-3b1a-4312-9147-4a00dee5db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0e95b3d-9f')
Aug 26 14:47:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUJjOuMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:47:48 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[173c2a95-4bbb-465d-a8f0-344784c3c3e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16615fc-d65e-44cb-a12f-b36e3332811f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:47:48 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:47:48 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:48 user nova-compute[73052]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:48 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 (non-flash)
Aug 26 14:47:48 user nova-compute[73052]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:47:48 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:48 user nova-compute[73052]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:48 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7232e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60d69b-3fd7-4603-936d-8e96888d9af9]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f6d90-af14-4ac2-9382-25d7e6078217]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15d16d6-bd14-4e01-a930-687fc1540276]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[56befb46-89ff-444c-b195-bfa54f48a202]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c162fd10-2b8e-4df1-a97f-fc19ebe859d0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:49 user nova-compute[73052]: WARNING nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 for instance with vm_state active and task_state deleting.
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-unplugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:49 user nova-compute[73052]: WARNING nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-ae26cb32-47d0-49d5-8be9-2ee917b6dd58 for instance with vm_state active and task_state deleting.
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-unplugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:49 user nova-compute[73052]: WARNING nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a for instance with vm_state active and task_state deleting.
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-unplugged-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-1c4b4593-ab54-4cbe-9c75-80943db7967f req-9533ef9c-8dd0-43c4-971a-cb0e82e37126 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-3f406875-cb83-48ab-ab45-742bd5a50965 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00e2011-8cfe-4192-a4e1-2d04508f7921]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7, portal: 172.16.0.220,3260]
Aug 26 14:47:49 user nova-compute[73052]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7, portal: 172.16.0.220,3260] successful.
Aug 26 14:47:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4963a10b-980c-49ed-b597-c8cf6cc642c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb4088f-ab5b-4165-9355-fb5d99c02d93]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== disconnect_volume: return (354ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZulUpHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:47:49 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[42107300-53db-4789-b1bc-fb3b52077c5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a16213-817d-453f-8cc0-c38aecdba2ae]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7232e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[38526194-df5b-4c06-9892-a8a963ccb37e]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4131e9-0b30-4dad-a357-6b0a87be1911]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4713365-fec9-4cf5-9fa9-61eb9b0489a0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bae7b2-cbd3-4861-b154-fc0b2dc380ed]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f790d-ac54-4d39-8e42-365c76ea37e5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3199c89-8864-44a9-9d5f-7ed64adb6a15]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827, portal: 172.16.0.220,3260]
Aug 26 14:47:49 user nova-compute[73052]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827, portal: 172.16.0.220,3260] successful.
Aug 26 14:47:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e2db4b-ebf1-4085-ace5-c0c14f445827 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8906f8f3-b806-47ae-a041-3fb05e164eb9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== disconnect_volume: return (326ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFmxZrlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:47:49 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca0b02c-8922-4e2b-ab37-7d00ffd3e911]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef6e396-0c10-4cbb-8fec-e8695c5ad036]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c733130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ed4aa0-9b91-489c-ba98-87d27ec8fba4]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ae5f9-d0ac-48f1-8e61-476784f14d7c]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99f13dd-9eaa-4d42-b3e3-9b37ae2ede9d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d85828-8112-4ff3-949b-ba5fcd4c4085]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca30feef-35a4-4d68-9066-7df112ceacc0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10d6e8c-5330-4c7d-a821-18030aafe502]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5, portal: 172.16.0.220,3260]
Aug 26 14:47:49 user nova-compute[73052]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5, portal: 172.16.0.220,3260] successful.
Aug 26 14:47:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b032ce08-a760-4a53-8413-a914a45fc3e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3851cbd-59ba-4ffe-af5d-7cbadb7edcbe]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] <== disconnect_volume: return (319ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:47:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Deleting instance files /opt/stack/data/nova/instances/74351d3b-b32d-4dc6-aaa3-25b11eadcabd_del
Aug 26 14:47:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Deletion of /opt/stack/data/nova/instances/74351d3b-b32d-4dc6-aaa3-25b11eadcabd_del complete
Aug 26 14:47:49 user nova-compute[73052]: INFO nova.compute.manager [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Took 3.55 seconds to destroy the instance on the hypervisor.
Aug 26 14:47:49 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:47:49 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:47:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:51 user nova-compute[73052]: WARNING nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-3f406875-cb83-48ab-ab45-742bd5a50965 for instance with vm_state active and task_state deleting.
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-unplugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:51 user nova-compute[73052]: WARNING nova.compute.manager [req-9e3e0c3e-2ad6-4efd-8d71-9e4639034218 req-a37d92db-1ee3-42c9-96a9-a2693f17ffe8 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 for instance with vm_state active and task_state deleting.
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-72e166e6-297d-4db2-abcc-6d3b8f6ed6b3 req-68593965-b259-4874-b04d-11508cba3331 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-72e166e6-297d-4db2-abcc-6d3b8f6ed6b3 req-68593965-b259-4874-b04d-11508cba3331 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-72e166e6-297d-4db2-abcc-6d3b8f6ed6b3 req-68593965-b259-4874-b04d-11508cba3331 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-72e166e6-297d-4db2-abcc-6d3b8f6ed6b3 req-68593965-b259-4874-b04d-11508cba3331 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-72e166e6-297d-4db2-abcc-6d3b8f6ed6b3 req-68593965-b259-4874-b04d-11508cba3331 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-unplugged-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-72e166e6-297d-4db2-abcc-6d3b8f6ed6b3 req-68593965-b259-4874-b04d-11508cba3331 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-62b21ac6-26c0-4ac2-8952-62e83a48124a for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:47:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-567fabed-df55-4dc0-9244-0b08bbb2fd45 req-aa8a5831-5412-4ac6-b1fb-336886df1625 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-changed-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-567fabed-df55-4dc0-9244-0b08bbb2fd45 req-aa8a5831-5412-4ac6-b1fb-336886df1625 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Refreshing instance network info cache due to event network-changed-fd15d9bd-b847-4224-8279-fa3bbb3958b9. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:47:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-567fabed-df55-4dc0-9244-0b08bbb2fd45 req-aa8a5831-5412-4ac6-b1fb-336886df1625 service nova] Acquiring lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:47:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-567fabed-df55-4dc0-9244-0b08bbb2fd45 req-aa8a5831-5412-4ac6-b1fb-336886df1625 service nova] Acquired lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:47:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-567fabed-df55-4dc0-9244-0b08bbb2fd45 req-aa8a5831-5412-4ac6-b1fb-336886df1625 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Refreshing network info cache for port fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:53 user nova-compute[73052]: WARNING nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-62b21ac6-26c0-4ac2-8952-62e83a48124a for instance with vm_state active and task_state deleting.
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-unplugged-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-unplugged-da95257c-a83b-41fe-b0c8-68859c558e24 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Acquiring lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] No waiting events found dispatching network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:47:53 user nova-compute[73052]: WARNING nova.compute.manager [req-9fb8d1d2-0d25-4cb3-9baf-c2029934d8bf req-748ec10a-222a-4c0e-a5e5-5cb0b291d370 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received unexpected event network-vif-plugged-da95257c-a83b-41fe-b0c8-68859c558e24 for instance with vm_state active and task_state deleting.
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:47:53 user nova-compute[73052]: INFO nova.compute.manager [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Detaching volume 0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99
Aug 26 14:47:53 user nova-compute[73052]: INFO nova.virt.block_device [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attempting to driver detach volume 0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 from mountpoint /dev/vdb
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Attempting to detach device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:47:53 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:47:53 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:47:53 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:47:53 user nova-compute[73052]:   <serial>0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99</serial>
Aug 26 14:47:53 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:47:53 user nova-compute[73052]: </disk>
Aug 26 14:47:53 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:53 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully detached device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the persistent domain config.
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:47:53 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:47:53 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:47:53 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:47:53 user nova-compute[73052]:   <serial>0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99</serial>
Aug 26 14:47:53 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:47:53 user nova-compute[73052]: </disk>
Aug 26 14:47:53 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-69be4baa-44ca-4451-98ba-bd50f0e6a426 req-0d44151a-071a-4cf8-86ba-d8f752b1c7cc service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-deleted-62b21ac6-26c0-4ac2-8952-62e83a48124a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:53 user nova-compute[73052]: INFO nova.compute.manager [req-69be4baa-44ca-4451-98ba-bd50f0e6a426 req-0d44151a-071a-4cf8-86ba-d8f752b1c7cc service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Neutron deleted interface 62b21ac6-26c0-4ac2-8952-62e83a48124a; detaching it from the instance and deleting it from the info cache
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.network.neutron [req-69be4baa-44ca-4451-98ba-bd50f0e6a426 req-0d44151a-071a-4cf8-86ba-d8f752b1c7cc service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [{"id": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "address": "fa:16:3e:1d:40:29", "network": {"id": "3e368788-00ca-4265-be3b-b13b8d6f754f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-793267914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d358577-b2", "ovs_interfaceid": "3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-69be4baa-44ca-4451-98ba-bd50f0e6a426 req-0d44151a-071a-4cf8-86ba-d8f752b1c7cc service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Detach interface failed, port_id=62b21ac6-26c0-4ac2-8952-62e83a48124a, reason: Instance 74351d3b-b32d-4dc6-aaa3-25b11eadcabd could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG nova.network.neutron [req-567fabed-df55-4dc0-9244-0b08bbb2fd45 req-aa8a5831-5412-4ac6-b1fb-336886df1625 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updated VIF entry in instance network info cache for port fd15d9bd-b847-4224-8279-fa3bbb3958b9. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG nova.network.neutron [req-567fabed-df55-4dc0-9244-0b08bbb2fd45 req-aa8a5831-5412-4ac6-b1fb-336886df1625 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-567fabed-df55-4dc0-9244-0b08bbb2fd45 req-aa8a5831-5412-4ac6-b1fb-336886df1625 service nova] Releasing lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061274.2216089, 92558f0f-dc80-4acf-b3b9-27d0244c0ddb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:47:54 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully detached device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the live domain config.
Aug 26 14:47:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWHoUcsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:47:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[639be8dd-bd30-4c31-a315-f018d39d0bcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b628f-bfbc-4f25-9d19-713452077180]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 (non-flash)
Aug 26 14:47:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7228c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7151a3-be69-4379-bbdf-c99138f6392f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1218eea-e4a3-4eb8-9bb5-167e847debba]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[56253ced-8892-4337-8876-18caccbd8a50]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9049167a-2df8-4f63-90b3-4d74b19ecd4a]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbfeac8-ba5a-4ba5-9807-fcc4059e99f4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0781e0f-cf2a-4e13-87e0-2bddf9426999]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99, portal: 172.16.0.220,3260]
Aug 26 14:47:54 user nova-compute[73052]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99, portal: 172.16.0.220,3260] successful.
Aug 26 14:47:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5bf0bf-17a6-4af4-a9c1-7eee1f1b7b99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d70744d-a39f-4ecc-bedc-b523f6a6e0ed]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== disconnect_volume: return (328ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:47:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:47:55 user nova-compute[73052]: DEBUG nova.objects.instance [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:47:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-176ad84b-87bd-4b84-b8c4-574ad0e569ab tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.992s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:47:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG nova.compute.manager [req-72480777-f753-4887-8168-1050330d786c req-640e0649-5010-4416-9251-3ca13b76b3e0 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-deleted-3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:56 user nova-compute[73052]: INFO nova.compute.manager [req-72480777-f753-4887-8168-1050330d786c req-640e0649-5010-4416-9251-3ca13b76b3e0 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Neutron deleted interface 3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7; detaching it from the instance and deleting it from the info cache
Aug 26 14:47:56 user nova-compute[73052]: DEBUG nova.network.neutron [req-72480777-f753-4887-8168-1050330d786c req-640e0649-5010-4416-9251-3ca13b76b3e0 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [{"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "da95257c-a83b-41fe-b0c8-68859c558e24", "address": "fa:16:3e:16:82:8e", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda95257c-a8", "ovs_interfaceid": "da95257c-a83b-41fe-b0c8-68859c558e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG nova.compute.manager [req-72480777-f753-4887-8168-1050330d786c req-640e0649-5010-4416-9251-3ca13b76b3e0 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Detach interface failed, port_id=3d358577-b2d6-4d5b-943d-2ea1d5a1f1a7, reason: Instance 74351d3b-b32d-4dc6-aaa3-25b11eadcabd could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:47:56 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:47:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updating instance_info_cache with network_info: [{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:47:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:47:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-9bf0a730-490a-431e-ac0b-9ab040d745e7 req-a7562031-a53a-48bf-b548-2b6a58ce63a9 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-deleted-da95257c-a83b-41fe-b0c8-68859c558e24 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:58 user nova-compute[73052]: INFO nova.compute.manager [req-9bf0a730-490a-431e-ac0b-9ab040d745e7 req-a7562031-a53a-48bf-b548-2b6a58ce63a9 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Neutron deleted interface da95257c-a83b-41fe-b0c8-68859c558e24; detaching it from the instance and deleting it from the info cache
Aug 26 14:47:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-9bf0a730-490a-431e-ac0b-9ab040d745e7 req-a7562031-a53a-48bf-b548-2b6a58ce63a9 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [{"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3f406875-cb83-48ab-ab45-742bd5a50965", "address": "fa:16:3e:2d:9d:d0", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f406875-cb", "ovs_interfaceid": "3f406875-cb83-48ab-ab45-742bd5a50965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-9bf0a730-490a-431e-ac0b-9ab040d745e7 req-a7562031-a53a-48bf-b548-2b6a58ce63a9 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Detach interface failed, port_id=da95257c-a83b-41fe-b0c8-68859c558e24, reason: Instance 74351d3b-b32d-4dc6-aaa3-25b11eadcabd could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:47:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-9bf0a730-490a-431e-ac0b-9ab040d745e7 req-a7562031-a53a-48bf-b548-2b6a58ce63a9 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-deleted-3f406875-cb83-48ab-ab45-742bd5a50965 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:47:58 user nova-compute[73052]: INFO nova.compute.manager [req-9bf0a730-490a-431e-ac0b-9ab040d745e7 req-a7562031-a53a-48bf-b548-2b6a58ce63a9 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Neutron deleted interface 3f406875-cb83-48ab-ab45-742bd5a50965; detaching it from the instance and deleting it from the info cache
Aug 26 14:47:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-9bf0a730-490a-431e-ac0b-9ab040d745e7 req-a7562031-a53a-48bf-b548-2b6a58ce63a9 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [{"id": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "address": "fa:16:3e:e7:d2:d8", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26cb32-47", "ovs_interfaceid": "ae26cb32-47d0-49d5-8be9-2ee917b6dd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "address": "fa:16:3e:9a:57:1a", "network": {"id": "d1a0d087-dc89-4f5e-8900-2faaf816ae88", "bridge": "br-int", "label": "tempest-device-tagging-net1-770343740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3e96f7-dc", "ovs_interfaceid": "dc3e96f7-dc70-4f9f-aff4-e9a5dd4f7b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "address": "fa:16:3e:da:54:d5", "network": {"id": "4d0dd8d0-3b1a-4312-9147-4a00dee5db13", "bridge": "br-int", "label": "tempest-device-tagging-net2-864840265", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72fbf87994b3497c86c16c8ce605aaa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e95b3d-9f", "ovs_interfaceid": "b0e95b3d-9f00-4995-bf49-24eec8b11fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-9bf0a730-490a-431e-ac0b-9ab040d745e7 req-a7562031-a53a-48bf-b548-2b6a58ce63a9 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Detach interface failed, port_id=3f406875-cb83-48ab-ab45-742bd5a50965, reason: Instance 74351d3b-b32d-4dc6-aaa3-25b11eadcabd could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:47:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:58 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:47:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:47:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:47:58 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Took 8.97 seconds to deallocate network for instance.
Aug 26 14:47:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:47:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-bfd97a85-90bf-4e6c-8432-1e5fe5b8a516 req-ecb59ed8-af7a-4e35-b3fd-42ce0b9e6153 service nova] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Received event network-vif-deleted-b0e95b3d-9f00-4995-bf49-24eec8b11fe9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:01 user nova-compute[73052]: INFO nova.compute.manager [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Took 2.46 seconds to detach 3 volumes for instance.
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG nova.objects.instance [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'flavor' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:01 user nova-compute[73052]: INFO nova.compute.manager [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Attaching volume b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 to /dev/vdb
Aug 26 14:48:01 user nova-compute[73052]: DEBUG os_brick.utils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[64adfd9e-84e8-47ef-9a70-1203904f0381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ad5ef9-f0b0-429f-b5c7-7dc75209d3c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c35bf3-caee-4185-8ead-e4397d861d71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef3e6b-95ec-4e19-9904-399e79e853c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:48:01 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f19b6-d189-453c-bd23-6b3bd0ec7a95]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG os_brick.utils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating existing volume attachment record: 0f33ca40-6758-4c2b-bcbb-b48a2a6213e2 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:01 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:48:01 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Deleted allocations for instance 74351d3b-b32d-4dc6-aaa3-25b11eadcabd
Aug 26 14:48:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8a7a6f46-f405-4129-b60d-6876e56da101 tempest-TaggedBootDevicesTest_v242-1487698790 tempest-TaggedBootDevicesTest_v242-1487698790-project-member] Lock "74351d3b-b32d-4dc6-aaa3-25b11eadcabd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.746s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.278s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061268.3426, 74351d3b-b32d-4dc6-aaa3-25b11eadcabd => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:03 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] VM Stopped (Lifecycle Event)
Aug 26 14:48:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e8f1d855-05dd-48e3-98e7-326c3cd66a1a None None] [instance: 74351d3b-b32d-4dc6-aaa3-25b11eadcabd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-4a0f1551-5110-45df-8bce-8d945c33bb26 req-e11f6539-e043-4005-bc1a-b01a1ceb9ad7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received event network-changed-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-4a0f1551-5110-45df-8bce-8d945c33bb26 req-e11f6539-e043-4005-bc1a-b01a1ceb9ad7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Refreshing instance network info cache due to event network-changed-e9280eae-40b0-4dbb-b31a-7499008b1cf9. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4a0f1551-5110-45df-8bce-8d945c33bb26 req-e11f6539-e043-4005-bc1a-b01a1ceb9ad7 service nova] Acquiring lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4a0f1551-5110-45df-8bce-8d945c33bb26 req-e11f6539-e043-4005-bc1a-b01a1ceb9ad7 service nova] Acquired lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG nova.network.neutron [req-4a0f1551-5110-45df-8bce-8d945c33bb26 req-e11f6539-e043-4005-bc1a-b01a1ceb9ad7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Refreshing network info cache for port e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG nova.network.neutron [req-4a0f1551-5110-45df-8bce-8d945c33bb26 req-e11f6539-e043-4005-bc1a-b01a1ceb9ad7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Updated VIF entry in instance network info cache for port e9280eae-40b0-4dbb-b31a-7499008b1cf9. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG nova.network.neutron [req-4a0f1551-5110-45df-8bce-8d945c33bb26 req-e11f6539-e043-4005-bc1a-b01a1ceb9ad7 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Updating instance_info_cache with network_info: [{"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4a0f1551-5110-45df-8bce-8d945c33bb26 req-e11f6539-e043-4005-bc1a-b01a1ceb9ad7 service nova] Releasing lock "refresh_cache-86d43ddf-d653-4771-9d24-4c3617664337" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:07 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:07 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7334MB free_disk=25.335445404052734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 79922a3f-53e3-4d29-8000-902e986e30c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7e88d68a-33cf-467a-9e55-8162648a2b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c35499ba-06cb-443c-b019-5d3f9ea4c04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 86d43ddf-d653-4771-9d24-4c3617664337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:48:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:09 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:48:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:48:12 user nova-compute[73052]: INFO nova.compute.claims [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Claim successful on node user
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:48:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.policy [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e018816042ce4330b8df928c3091c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828e21454a0e4cc096cc95718e934697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:48:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Creating image(s)
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "/opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "/opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "/opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk 1073741824" returned: 0 in 0.050s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Cannot resize image /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Ensure instance console log exists: /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Successfully created port: 01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:48:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Successfully updated port: 01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "refresh_cache-23d61b14-f1ce-4dd0-b46a-d61565ba02d5" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquired lock "refresh_cache-23d61b14-f1ce-4dd0-b46a-d61565ba02d5" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-d1ece2c8-36c1-4c6d-b236-2dd27716947a req-5c75936a-e439-4eeb-a135-b92f529e820c service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received event network-changed-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-d1ece2c8-36c1-4c6d-b236-2dd27716947a req-5c75936a-e439-4eeb-a135-b92f529e820c service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Refreshing instance network info cache due to event network-changed-01c8e78a-b9da-48be-a62d-0ad1c12fb669. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1ece2c8-36c1-4c6d-b236-2dd27716947a req-5c75936a-e439-4eeb-a135-b92f529e820c service nova] Acquiring lock "refresh_cache-23d61b14-f1ce-4dd0-b46a-d61565ba02d5" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Updating instance_info_cache with network_info: [{"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Releasing lock "refresh_cache-23d61b14-f1ce-4dd0-b46a-d61565ba02d5" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Instance network_info: |[{"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1ece2c8-36c1-4c6d-b236-2dd27716947a req-5c75936a-e439-4eeb-a135-b92f529e820c service nova] Acquired lock "refresh_cache-23d61b14-f1ce-4dd0-b46a-d61565ba02d5" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-d1ece2c8-36c1-4c6d-b236-2dd27716947a req-5c75936a-e439-4eeb-a135-b92f529e820c service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Refreshing network info cache for port 01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Start _get_guest_xml network_info=[{"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:48:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-297620938',display_name='tempest-DeleteServersTestJSON-server-297620938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-297620938',id=21,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828e21454a0e4cc096cc95718e934697',ramdisk_id='',reservation_id='r-3wr86hwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-402805084',owner_user_name='tempest-DeleteServersTestJSON-402805084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:48:13Z,user_data=None,user_id='e018816042ce4330b8df928c3091c3c7',uuid=23d61b14-f1ce-4dd0-b46a-d61565ba02d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Converting VIF {"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:bf:27,bridge_name='br-int',has_traffic_filtering=True,id=01c8e78a-b9da-48be-a62d-0ad1c12fb669,network=Network(7f7be07d-6609-4b26-bd59-0c0a8da0fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c8e78a-b9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lazy-loading 'pci_devices' on Instance uuid 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:48:15 user nova-compute[73052]:   <uuid>23d61b14-f1ce-4dd0-b46a-d61565ba02d5</uuid>
Aug 26 14:48:15 user nova-compute[73052]:   <name>instance-00000015</name>
Aug 26 14:48:15 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:48:15 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:48:15 user nova-compute[73052]:   <metadata>
Aug 26 14:48:15 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:48:15 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:48:15 user nova-compute[73052]:       <nova:name>tempest-DeleteServersTestJSON-server-297620938</nova:name>
Aug 26 14:48:15 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:48:15</nova:creationTime>
Aug 26 14:48:15 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:48:15 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:48:15 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:48:15 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:48:15 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:48:15 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:48:15 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:48:15 user nova-compute[73052]:       <nova:owner>
Aug 26 14:48:15 user nova-compute[73052]:         <nova:user uuid="e018816042ce4330b8df928c3091c3c7">tempest-DeleteServersTestJSON-402805084-project-member</nova:user>
Aug 26 14:48:15 user nova-compute[73052]:         <nova:project uuid="828e21454a0e4cc096cc95718e934697">tempest-DeleteServersTestJSON-402805084</nova:project>
Aug 26 14:48:15 user nova-compute[73052]:       </nova:owner>
Aug 26 14:48:15 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:48:15 user nova-compute[73052]:       <nova:ports>
Aug 26 14:48:15 user nova-compute[73052]:         <nova:port uuid="01c8e78a-b9da-48be-a62d-0ad1c12fb669">
Aug 26 14:48:15 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 14:48:15 user nova-compute[73052]:         </nova:port>
Aug 26 14:48:15 user nova-compute[73052]:       </nova:ports>
Aug 26 14:48:15 user nova-compute[73052]:     </nova:instance>
Aug 26 14:48:15 user nova-compute[73052]:   </metadata>
Aug 26 14:48:15 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:48:15 user nova-compute[73052]:     <system>
Aug 26 14:48:15 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:48:15 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:48:15 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:48:15 user nova-compute[73052]:       <entry name="serial">23d61b14-f1ce-4dd0-b46a-d61565ba02d5</entry>
Aug 26 14:48:15 user nova-compute[73052]:       <entry name="uuid">23d61b14-f1ce-4dd0-b46a-d61565ba02d5</entry>
Aug 26 14:48:15 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:48:15 user nova-compute[73052]:     </system>
Aug 26 14:48:15 user nova-compute[73052]:   </sysinfo>
Aug 26 14:48:15 user nova-compute[73052]:   <os>
Aug 26 14:48:15 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:48:15 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:48:15 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:48:15 user nova-compute[73052]:   </os>
Aug 26 14:48:15 user nova-compute[73052]:   <features>
Aug 26 14:48:15 user nova-compute[73052]:     <acpi/>
Aug 26 14:48:15 user nova-compute[73052]:     <apic/>
Aug 26 14:48:15 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:48:15 user nova-compute[73052]:   </features>
Aug 26 14:48:15 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:48:15 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:48:15 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:48:15 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:48:15 user nova-compute[73052]:   </clock>
Aug 26 14:48:15 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:48:15 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:48:15 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:48:15 user nova-compute[73052]:   </cpu>
Aug 26 14:48:15 user nova-compute[73052]:   <devices>
Aug 26 14:48:15 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:48:15 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:48:15 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk"/>
Aug 26 14:48:15 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:48:15 user nova-compute[73052]:     </disk>
Aug 26 14:48:15 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:48:15 user nova-compute[73052]:       <mac address="fa:16:3e:73:bf:27"/>
Aug 26 14:48:15 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:48:15 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:48:15 user nova-compute[73052]:       <target dev="tap01c8e78a-b9"/>
Aug 26 14:48:15 user nova-compute[73052]:     </interface>
Aug 26 14:48:15 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:48:15 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/console.log" append="off"/>
Aug 26 14:48:15 user nova-compute[73052]:     </serial>
Aug 26 14:48:15 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:48:15 user nova-compute[73052]:     <video>
Aug 26 14:48:15 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:48:15 user nova-compute[73052]:     </video>
Aug 26 14:48:15 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:48:15 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:48:15 user nova-compute[73052]:     </rng>
Aug 26 14:48:15 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:48:15 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:48:15 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:48:15 user nova-compute[73052]:     </memballoon>
Aug 26 14:48:15 user nova-compute[73052]:   </devices>
Aug 26 14:48:15 user nova-compute[73052]: </domain>
Aug 26 14:48:15 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-297620938',display_name='tempest-DeleteServersTestJSON-server-297620938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-297620938',id=21,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828e21454a0e4cc096cc95718e934697',ramdisk_id='',reservation_id='r-3wr86hwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-402805084',owner_user_name='tempest-DeleteServersTestJSON-402805084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:48:13Z,user_data=None,user_id='e018816042ce4330b8df928c3091c3c7',uuid=23d61b14-f1ce-4dd0-b46a-d61565ba02d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Converting VIF {"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:bf:27,bridge_name='br-int',has_traffic_filtering=True,id=01c8e78a-b9da-48be-a62d-0ad1c12fb669,network=Network(7f7be07d-6609-4b26-bd59-0c0a8da0fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c8e78a-b9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG os_vif [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:bf:27,bridge_name='br-int',has_traffic_filtering=True,id=01c8e78a-b9da-48be-a62d-0ad1c12fb669,network=Network(7f7be07d-6609-4b26-bd59-0c0a8da0fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c8e78a-b9') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01c8e78a-b9, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01c8e78a-b9, col_values=(('external_ids', {'iface-id': '01c8e78a-b9da-48be-a62d-0ad1c12fb669', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:bf:27', 'vm-uuid': '23d61b14-f1ce-4dd0-b46a-d61565ba02d5'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:15 user nova-compute[73052]: INFO os_vif [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:bf:27,bridge_name='br-int',has_traffic_filtering=True,id=01c8e78a-b9da-48be-a62d-0ad1c12fb669,network=Network(7f7be07d-6609-4b26-bd59-0c0a8da0fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c8e78a-b9')
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] No VIF found with MAC fa:16:3e:73:bf:27, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.017s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:48:16 user nova-compute[73052]: INFO nova.compute.claims [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Claim successful on node user
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.network.neutron [req-d1ece2c8-36c1-4c6d-b236-2dd27716947a req-5c75936a-e439-4eeb-a135-b92f529e820c service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Updated VIF entry in instance network info cache for port 01c8e78a-b9da-48be-a62d-0ad1c12fb669. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.network.neutron [req-d1ece2c8-36c1-4c6d-b236-2dd27716947a req-5c75936a-e439-4eeb-a135-b92f529e820c service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Updating instance_info_cache with network_info: [{"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1ece2c8-36c1-4c6d-b236-2dd27716947a req-5c75936a-e439-4eeb-a135-b92f529e820c service nova] Releasing lock "refresh_cache-23d61b14-f1ce-4dd0-b46a-d61565ba02d5" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.network.neutron [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:48:16 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:48:16 user nova-compute[73052]: INFO nova.virt.block_device [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Booting with volume snapshot 621de068-42cd-413c-9782-927eefe5f0a0 at /dev/vda
Aug 26 14:48:16 user nova-compute[73052]: DEBUG nova.policy [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce6cd78a2f7c407983d90a15ffb94967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8ab154558a4521920e05921722db36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKseBUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:17 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:17 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:17 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a4a8b-b8ff-4d55-a6ad-37aa581c3cac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:48:17 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-bfb1043b-4621-453e-b817-bfe396ebdd69 req-06b723e1-58ca-4b87-890c-371f87deda21 service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received event network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bfb1043b-4621-453e-b817-bfe396ebdd69 req-06b723e1-58ca-4b87-890c-371f87deda21 service nova] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bfb1043b-4621-453e-b817-bfe396ebdd69 req-06b723e1-58ca-4b87-890c-371f87deda21 service nova] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bfb1043b-4621-453e-b817-bfe396ebdd69 req-06b723e1-58ca-4b87-890c-371f87deda21 service nova] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-bfb1043b-4621-453e-b817-bfe396ebdd69 req-06b723e1-58ca-4b87-890c-371f87deda21 service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] No waiting events found dispatching network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:17 user nova-compute[73052]: WARNING nova.compute.manager [req-bfb1043b-4621-453e-b817-bfe396ebdd69 req-06b723e1-58ca-4b87-890c-371f87deda21 service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received unexpected event network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 for instance with vm_state building and task_state spawning.
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[45214ff3-74b8-4e3c-94e8-52795c8c4f75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7] added
Aug 26 14:48:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG nova.objects.instance [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lazy-loading 'flavor' on Instance uuid 86d43ddf-d653-4771-9d24-4c3617664337 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e3ccc-844c-4c1b-8560-137b9be6149c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG nova.network.neutron [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Successfully created port: 226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4495de7-0031-4c78-a7ff-2b69343ba4ea]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKseBUIZ {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKseBUIZ" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[812d0306-c539-4c90-8233-d39bf903037a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EKseBUIZ'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dbc70a-1652-494d-86d9-4078a4b36b59]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d2d87f-8606-4fbe-84fd-8fd347b17ae8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:48:17 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:48:17 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:17 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 14:48:17 user nova-compute[73052]: 
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c627cf-06c1-4d4a-95c0-aae317e55164]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260]
Aug 26 14:48:17 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260] successful.
Aug 26 14:48:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9cbf44-de22-4b7d-a1fb-4f3bfe0c028f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a6d780-9534-4f3a-ad7c-338d08d5cd52]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf4f496-44cb-42bd-b74e-ee3c522c62de]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKseBUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:17 user nova-compute[73052]: INFO nova.compute.manager [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Attaching volume 0347dd16-c971-40fa-8860-cc85cc2021a2 to /dev/vdb
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.utils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a5bce7-6e9e-4c96-aaa7-d6bd216cd8df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e2a70-2893-4ecd-9ba7-dbcbc5b40376]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da21fc1-7ee9-4f7a-8b44-beb313e0a740]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c5ec7-5c3b-4722-a10b-c0ea9057840f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:48:17 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:48:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45b89fc-aad8-4550-9daf-b3917db671f1]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG os_brick.utils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:17 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Updating existing volume attachment record: 07b74918-1400-4e43-91c0-3adab469132e {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Successfully updated port: 226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "refresh_cache-e036233c-9812-4f01-a74b-bdfd6ca23b4f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquired lock "refresh_cache-e036233c-9812-4f01-a74b-bdfd6ca23b4f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-b48edd45-d070-446e-9c15-d553581d6a86 req-59b5263d-e1c5-4c98-8e3e-aae8d07f1a43 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received event network-changed-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-b48edd45-d070-446e-9c15-d553581d6a86 req-59b5263d-e1c5-4c98-8e3e-aae8d07f1a43 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Refreshing instance network info cache due to event network-changed-226ca57a-f424-4dd5-ad46-1acac336f402. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b48edd45-d070-446e-9c15-d553581d6a86 req-59b5263d-e1c5-4c98-8e3e-aae8d07f1a43 service nova] Acquiring lock "refresh_cache-e036233c-9812-4f01-a74b-bdfd6ca23b4f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23430316565333734', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430316565333734', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.objects.instance [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'flavor' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Updating instance_info_cache with network_info: [{"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:48:18 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:48:18 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:48:18 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:48:18 user nova-compute[73052]:   <serial>b5d8e6df-0e5b-4ac9-b439-8813018e0fc7</serial>
Aug 26 14:48:18 user nova-compute[73052]: </disk>
Aug 26 14:48:18 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Releasing lock "refresh_cache-e036233c-9812-4f01-a74b-bdfd6ca23b4f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Instance network_info: |[{"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b48edd45-d070-446e-9c15-d553581d6a86 req-59b5263d-e1c5-4c98-8e3e-aae8d07f1a43 service nova] Acquired lock "refresh_cache-e036233c-9812-4f01-a74b-bdfd6ca23b4f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:18 user nova-compute[73052]: DEBUG nova.network.neutron [req-b48edd45-d070-446e-9c15-d553581d6a86 req-59b5263d-e1c5-4c98-8e3e-aae8d07f1a43 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Refreshing network info cache for port 226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No VIF found with MAC fa:16:3e:1f:a8:07, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.network.neutron [req-b48edd45-d070-446e-9c15-d553581d6a86 req-59b5263d-e1c5-4c98-8e3e-aae8d07f1a43 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Updated VIF entry in instance network info cache for port 226ca57a-f424-4dd5-ad46-1acac336f402. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.network.neutron [req-b48edd45-d070-446e-9c15-d553581d6a86 req-59b5263d-e1c5-4c98-8e3e-aae8d07f1a43 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Updating instance_info_cache with network_info: [{"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b48edd45-d070-446e-9c15-d553581d6a86 req-59b5263d-e1c5-4c98-8e3e-aae8d07f1a43 service nova] Releasing lock "refresh_cache-e036233c-9812-4f01-a74b-bdfd6ca23b4f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01ddab98-de4b-417a-bc68-f01d335d01a0 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.761s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061299.3446286, 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] VM Resumed (Lifecycle Event)
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:48:19 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Instance spawned successfully.
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061299.346246, 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] VM Started (Lifecycle Event)
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-062dd8d3-43f5-45c8-93b8-ceac446e2332 req-15d3fb9b-1839-48bd-850e-a454f25f6158 service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received event network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-062dd8d3-43f5-45c8-93b8-ceac446e2332 req-15d3fb9b-1839-48bd-850e-a454f25f6158 service nova] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-062dd8d3-43f5-45c8-93b8-ceac446e2332 req-15d3fb9b-1839-48bd-850e-a454f25f6158 service nova] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-062dd8d3-43f5-45c8-93b8-ceac446e2332 req-15d3fb9b-1839-48bd-850e-a454f25f6158 service nova] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-062dd8d3-43f5-45c8-93b8-ceac446e2332 req-15d3fb9b-1839-48bd-850e-a454f25f6158 service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] No waiting events found dispatching network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:19 user nova-compute[73052]: WARNING nova.compute.manager [req-062dd8d3-43f5-45c8-93b8-ceac446e2332 req-15d3fb9b-1839-48bd-850e-a454f25f6158 service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received unexpected event network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 for instance with vm_state building and task_state spawning.
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:48:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:48:19 user nova-compute[73052]: INFO nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 26 14:48:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:19 user nova-compute[73052]: INFO nova.compute.manager [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Took 6.75 seconds to build instance.
Aug 26 14:48:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0091795e-d48f-4882-9c95-f9b826f8974d tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.838s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG os_brick.utils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[129d81d9-a5e8-460a-9d4c-17825c95dab5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[81010b19-3df1-4c6a-a05a-4b6a80fe3614]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b7eb52-53b7-4806-a0d0-faa156fe6831]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de008b3-ab69-482d-97b0-debb9c52c22a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:48:22 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:48:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71e3484-20ed-412e-a6be-05fd0f642b1e]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG os_brick.utils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:22 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Updating existing volume attachment record: 3b107112-8f4c-4d0d-aad1-da3ea0704940 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:48:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhMYyDzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:31 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:31 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:31 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6228f6f0-35a1-4a7e-a1ad-1bf6f22c5c03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:48:31 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b9a28e-3cac-46f5-a272-1668559f13fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2] added
Aug 26 14:48:31 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e33807c-a80a-4ec1-8fbe-76d05fcb60c5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4fa441-0ac8-470c-807f-cfacff8d36eb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhMYyDzd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhMYyDzd" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcced63-47ce-4790-95b1-8e395f03a2a2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PhMYyDzd'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8df16ff-4b05-4c64-a783-12196376ef2e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0044a9e6-4b35-453c-b3ce-b46ffae4969c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:32 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:32 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7014fe0-2662-4b16-8727-970482d34d0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2, portal: 172.16.0.220,3260]
Aug 26 14:48:32 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2, portal: 172.16.0.220,3260] successful.
Aug 26 14:48:32 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3c73e2-10b8-4477-b9bf-4c23ae700a1d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b178ba45-6f26-4159-a619-be335f947788]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:32 user nova-compute[73052]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)
Aug 26 14:48:32 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:32 user nova-compute[73052]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)
Aug 26 14:48:32 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b22abdc-4073-40f4-82cb-bb7617c6c8b5]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:48:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhMYyDzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26238623239313061', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238623239313061', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG nova.objects.instance [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lazy-loading 'flavor' on Instance uuid 86d43ddf-d653-4771-9d24-4c3617664337 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:48:33 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:48:33 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:48:33 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:48:33 user nova-compute[73052]:   <serial>0347dd16-c971-40fa-8860-cc85cc2021a2</serial>
Aug 26 14:48:33 user nova-compute[73052]: </disk>
Aug 26 14:48:33 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] No VIF found with MAC fa:16:3e:ee:8c:65, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:48:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4741e85d-980f-4730-a466-328b24ac164d tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.031s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:48:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Creating image(s)
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Ensure instance console log exists: /opt/stack/data/nova/instances/e036233c-9812-4f01-a74b-bdfd6ca23b4f/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Start _get_guest_xml network_info=[{"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '3b107112-8f4c-4d0d-aad1-da3ea0704940', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgeDqwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e036233c-9812-4f01-a74b-bdfd6ca23b4f', 'attached_at': '', 'detached_at': '', 'volume_id': '5516c6bf-4e19-47c8-a7ee-2f22407871ed', 'serial': '5516c6bf-4e19-47c8-a7ee-2f22407871ed'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:48:34 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:34 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgeDqwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:34 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:34 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:34 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31a693-d98c-44e2-bfde-92e694db4a10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:48:34 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a9583a-b1b6-417a-8dff-d07c65f046e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed] added
Aug 26 14:48:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5338d0ef-0b1b-423d-8606-d1824e59d05c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eee193e-9947-48f0-a1a0-4c93b1604842]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGgeDqwP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGgeDqwP" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b683a75-dfac-4362-b26f-1ce25473d2cf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGgeDqwP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a602a7-0ec7-4d91-be83-d5308af3806f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[39757940-3752-4e72-a84c-60bfd3f36d88]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:34 user nova-compute[73052]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)
Aug 26 14:48:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:34 user nova-compute[73052]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)
Aug 26 14:48:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6646ce2-36b7-4c04-afb6-bddc52e5b711]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed, portal: 172.16.0.220,3260]
Aug 26 14:48:34 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed, portal: 172.16.0.220,3260] successful.
Aug 26 14:48:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[386b0384-f69e-4771-9a2d-463432a038ba]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9975f4-1c90-4e3c-8bdc-4405025d8c0a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:34 user nova-compute[73052]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)
Aug 26 14:48:34 user nova-compute[73052]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:34 user nova-compute[73052]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)
Aug 26 14:48:34 user nova-compute[73052]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6854308-c2bf-4071-adfa-1c7600e8c6b2]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:48:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgeDqwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:35 user nova-compute[73052]: INFO nova.compute.manager [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Detaching volume 0347dd16-c971-40fa-8860-cc85cc2021a2
Aug 26 14:48:35 user nova-compute[73052]: INFO nova.virt.block_device [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Attempting to driver detach volume 0347dd16-c971-40fa-8860-cc85cc2021a2 from mountpoint /dev/vdb
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Attempting to detach device vdb from instance 86d43ddf-d653-4771-9d24-4c3617664337 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:48:35 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:48:35 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:48:35 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:48:35 user nova-compute[73052]:   <serial>0347dd16-c971-40fa-8860-cc85cc2021a2</serial>
Aug 26 14:48:35 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:48:35 user nova-compute[73052]: </disk>
Aug 26 14:48:35 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:48:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Successfully detached device vdb from instance 86d43ddf-d653-4771-9d24-4c3617664337 from the persistent domain config.
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86d43ddf-d653-4771-9d24-4c3617664337 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:48:35 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:48:35 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:48:35 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:48:35 user nova-compute[73052]:   <serial>0347dd16-c971-40fa-8860-cc85cc2021a2</serial>
Aug 26 14:48:35 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:48:35 user nova-compute[73052]: </disk>
Aug 26 14:48:35 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26362623864656532', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362623864656532', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-736480186',display_name='tempest-TestVolumeBootPattern-server-736480186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-736480186',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-64ebmw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:48:17Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=e036233c-9812-4f01-a74b-bdfd6ca23b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c2:46,bridge_name='br-int',has_traffic_filtering=True,id=226ca57a-f424-4dd5-ad46-1acac336f402,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ca57a-f4') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.objects.instance [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'pci_devices' on Instance uuid e036233c-9812-4f01-a74b-bdfd6ca23b4f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:48:35 user nova-compute[73052]:   <uuid>e036233c-9812-4f01-a74b-bdfd6ca23b4f</uuid>
Aug 26 14:48:35 user nova-compute[73052]:   <name>instance-00000016</name>
Aug 26 14:48:35 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:48:35 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:48:35 user nova-compute[73052]:   <metadata>
Aug 26 14:48:35 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:48:35 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:48:35 user nova-compute[73052]:       <nova:name>tempest-TestVolumeBootPattern-server-736480186</nova:name>
Aug 26 14:48:35 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:48:34</nova:creationTime>
Aug 26 14:48:35 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:48:35 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:48:35 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:48:35 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:48:35 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:48:35 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:48:35 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:48:35 user nova-compute[73052]:       <nova:owner>
Aug 26 14:48:35 user nova-compute[73052]:         <nova:user uuid="ce6cd78a2f7c407983d90a15ffb94967">tempest-TestVolumeBootPattern-772605316-project-member</nova:user>
Aug 26 14:48:35 user nova-compute[73052]:         <nova:project uuid="1e8ab154558a4521920e05921722db36">tempest-TestVolumeBootPattern-772605316</nova:project>
Aug 26 14:48:35 user nova-compute[73052]:       </nova:owner>
Aug 26 14:48:35 user nova-compute[73052]:       <nova:ports>
Aug 26 14:48:35 user nova-compute[73052]:         <nova:port uuid="226ca57a-f424-4dd5-ad46-1acac336f402">
Aug 26 14:48:35 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:48:35 user nova-compute[73052]:         </nova:port>
Aug 26 14:48:35 user nova-compute[73052]:       </nova:ports>
Aug 26 14:48:35 user nova-compute[73052]:     </nova:instance>
Aug 26 14:48:35 user nova-compute[73052]:   </metadata>
Aug 26 14:48:35 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:48:35 user nova-compute[73052]:     <system>
Aug 26 14:48:35 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:48:35 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:48:35 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:48:35 user nova-compute[73052]:       <entry name="serial">e036233c-9812-4f01-a74b-bdfd6ca23b4f</entry>
Aug 26 14:48:35 user nova-compute[73052]:       <entry name="uuid">e036233c-9812-4f01-a74b-bdfd6ca23b4f</entry>
Aug 26 14:48:35 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:48:35 user nova-compute[73052]:     </system>
Aug 26 14:48:35 user nova-compute[73052]:   </sysinfo>
Aug 26 14:48:35 user nova-compute[73052]:   <os>
Aug 26 14:48:35 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:48:35 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:48:35 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:48:35 user nova-compute[73052]:   </os>
Aug 26 14:48:35 user nova-compute[73052]:   <features>
Aug 26 14:48:35 user nova-compute[73052]:     <acpi/>
Aug 26 14:48:35 user nova-compute[73052]:     <apic/>
Aug 26 14:48:35 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:48:35 user nova-compute[73052]:   </features>
Aug 26 14:48:35 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:48:35 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:48:35 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:48:35 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:48:35 user nova-compute[73052]:   </clock>
Aug 26 14:48:35 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:48:35 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:48:35 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:48:35 user nova-compute[73052]:   </cpu>
Aug 26 14:48:35 user nova-compute[73052]:   <devices>
Aug 26 14:48:35 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:48:35 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:48:35 user nova-compute[73052]:       <source dev="/dev/sdd"/>
Aug 26 14:48:35 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:48:35 user nova-compute[73052]:       <serial>5516c6bf-4e19-47c8-a7ee-2f22407871ed</serial>
Aug 26 14:48:35 user nova-compute[73052]:     </disk>
Aug 26 14:48:35 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:48:35 user nova-compute[73052]:       <mac address="fa:16:3e:c5:c2:46"/>
Aug 26 14:48:35 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:48:35 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:48:35 user nova-compute[73052]:       <target dev="tap226ca57a-f4"/>
Aug 26 14:48:35 user nova-compute[73052]:     </interface>
Aug 26 14:48:35 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:48:35 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/e036233c-9812-4f01-a74b-bdfd6ca23b4f/console.log" append="off"/>
Aug 26 14:48:35 user nova-compute[73052]:     </serial>
Aug 26 14:48:35 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:48:35 user nova-compute[73052]:     <video>
Aug 26 14:48:35 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:48:35 user nova-compute[73052]:     </video>
Aug 26 14:48:35 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:48:35 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:48:35 user nova-compute[73052]:     </rng>
Aug 26 14:48:35 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:48:35 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:48:35 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:48:35 user nova-compute[73052]:     </memballoon>
Aug 26 14:48:35 user nova-compute[73052]:   </devices>
Aug 26 14:48:35 user nova-compute[73052]: </domain>
Aug 26 14:48:35 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-736480186',display_name='tempest-TestVolumeBootPattern-server-736480186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-736480186',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-64ebmw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:48:17Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=e036233c-9812-4f01-a74b-bdfd6ca23b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c2:46,bridge_name='br-int',has_traffic_filtering=True,id=226ca57a-f424-4dd5-ad46-1acac336f402,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ca57a-f4') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG os_vif [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c2:46,bridge_name='br-int',has_traffic_filtering=True,id=226ca57a-f424-4dd5-ad46-1acac336f402,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ca57a-f4') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap226ca57a-f4, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap226ca57a-f4, col_values=(('external_ids', {'iface-id': '226ca57a-f424-4dd5-ad46-1acac336f402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:c2:46', 'vm-uuid': 'e036233c-9812-4f01-a74b-bdfd6ca23b4f'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:35 user nova-compute[73052]: INFO os_vif [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c2:46,bridge_name='br-int',has_traffic_filtering=True,id=226ca57a-f424-4dd5-ad46-1acac336f402,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ca57a-f4')
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:48:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No VIF found with MAC fa:16:3e:c5:c2:46, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061316.0019135, 86d43ddf-d653-4771-9d24-4c3617664337 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86d43ddf-d653-4771-9d24-4c3617664337 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:48:36 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Successfully detached device vdb from instance 86d43ddf-d653-4771-9d24-4c3617664337 from the live domain config.
Aug 26 14:48:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhMYyDzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:36 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28cfb01-e8bc-4b85-bef4-77861f02d448]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea9487-b100-43eb-bf88-2ae2694f9005]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:36 user nova-compute[73052]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)
Aug 26 14:48:36 user nova-compute[73052]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:36 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:36 user nova-compute[73052]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 (non-flash)
Aug 26 14:48:36 user nova-compute[73052]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:36 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7f3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd1d0c7-dc5b-4640-86d9-077d745ff438]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7548f6b5-1eb4-4397-a3b9-1840efc5f7ee]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe262ff-d426-4853-853b-6354f8477ca9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e479b1-97ab-4450-8878-c50f8f5b2ec8]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[55849e9f-dd5d-4579-b0cf-9f1d20ff5c8a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[385ace54-f630-4cb8-ad90-92650aeed580]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2, portal: 172.16.0.220,3260]
Aug 26 14:48:36 user nova-compute[73052]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2, portal: 172.16.0.220,3260] successful.
Aug 26 14:48:36 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0347dd16-c971-40fa-8860-cc85cc2021a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9fe370-1268-41b5-9119-920decb026de]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] <== disconnect_volume: return (287ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:48:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG nova.objects.instance [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lazy-loading 'flavor' on Instance uuid 86d43ddf-d653-4771-9d24-4c3617664337 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8607018a-a98b-4864-a06e-c03906430b90 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-6f29f855-0578-4b5c-a91e-62b9702642fd req-ec9b35a5-aa7b-4f1f-9c43-befb6953dbf1 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received event network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6f29f855-0578-4b5c-a91e-62b9702642fd req-ec9b35a5-aa7b-4f1f-9c43-befb6953dbf1 service nova] Acquiring lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6f29f855-0578-4b5c-a91e-62b9702642fd req-ec9b35a5-aa7b-4f1f-9c43-befb6953dbf1 service nova] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6f29f855-0578-4b5c-a91e-62b9702642fd req-ec9b35a5-aa7b-4f1f-9c43-befb6953dbf1 service nova] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-6f29f855-0578-4b5c-a91e-62b9702642fd req-ec9b35a5-aa7b-4f1f-9c43-befb6953dbf1 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] No waiting events found dispatching network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:37 user nova-compute[73052]: WARNING nova.compute.manager [req-6f29f855-0578-4b5c-a91e-62b9702642fd req-ec9b35a5-aa7b-4f1f-9c43-befb6953dbf1 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received unexpected event network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 for instance with vm_state building and task_state spawning.
Aug 26 14:48:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-dc422fe2-337c-4de0-abfe-a32786f4bfc2 req-6678c726-9c25-4c9e-82ab-567b4a0ae9cd service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-dc422fe2-337c-4de0-abfe-a32786f4bfc2 req-6678c726-9c25-4c9e-82ab-567b4a0ae9cd service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing instance network info cache due to event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dc422fe2-337c-4de0-abfe-a32786f4bfc2 req-6678c726-9c25-4c9e-82ab-567b4a0ae9cd service nova] Acquiring lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dc422fe2-337c-4de0-abfe-a32786f4bfc2 req-6678c726-9c25-4c9e-82ab-567b4a0ae9cd service nova] Acquired lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG nova.network.neutron [req-dc422fe2-337c-4de0-abfe-a32786f4bfc2 req-6678c726-9c25-4c9e-82ab-567b4a0ae9cd service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG nova.network.neutron [req-dc422fe2-337c-4de0-abfe-a32786f4bfc2 req-6678c726-9c25-4c9e-82ab-567b4a0ae9cd service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updated VIF entry in instance network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG nova.network.neutron [req-dc422fe2-337c-4de0-abfe-a32786f4bfc2 req-6678c726-9c25-4c9e-82ab-567b4a0ae9cd service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating instance_info_cache with network_info: [{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dc422fe2-337c-4de0-abfe-a32786f4bfc2 req-6678c726-9c25-4c9e-82ab-567b4a0ae9cd service nova] Releasing lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061319.5686543, e036233c-9812-4f01-a74b-bdfd6ca23b4f => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:39 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] VM Resumed (Lifecycle Event)
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:48:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Instance spawned successfully.
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:39 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061319.5703764, e036233c-9812-4f01-a74b-bdfd6ca23b4f => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:39 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] VM Started (Lifecycle Event)
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:48:39 user nova-compute[73052]: INFO nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:39 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-6382fe2f-5e39-4715-89fa-e12e283e3d96 req-0347c632-77c0-4e31-9bbe-b509e790d3c9 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received event network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6382fe2f-5e39-4715-89fa-e12e283e3d96 req-0347c632-77c0-4e31-9bbe-b509e790d3c9 service nova] Acquiring lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6382fe2f-5e39-4715-89fa-e12e283e3d96 req-0347c632-77c0-4e31-9bbe-b509e790d3c9 service nova] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6382fe2f-5e39-4715-89fa-e12e283e3d96 req-0347c632-77c0-4e31-9bbe-b509e790d3c9 service nova] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-6382fe2f-5e39-4715-89fa-e12e283e3d96 req-0347c632-77c0-4e31-9bbe-b509e790d3c9 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] No waiting events found dispatching network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:39 user nova-compute[73052]: WARNING nova.compute.manager [req-6382fe2f-5e39-4715-89fa-e12e283e3d96 req-0347c632-77c0-4e31-9bbe-b509e790d3c9 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received unexpected event network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 for instance with vm_state building and task_state spawning.
Aug 26 14:48:39 user nova-compute[73052]: INFO nova.compute.manager [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Took 23.86 seconds to build instance.
Aug 26 14:48:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cef90b87-c89e-4c93-a099-c617ff81dcd4 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.954s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-62ef1516-0f0d-44e1-8dba-a888f392b555 req-c1d62cf2-eee2-4051-9de8-57e0f60b43c2 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-62ef1516-0f0d-44e1-8dba-a888f392b555 req-c1d62cf2-eee2-4051-9de8-57e0f60b43c2 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing instance network info cache due to event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:48:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62ef1516-0f0d-44e1-8dba-a888f392b555 req-c1d62cf2-eee2-4051-9de8-57e0f60b43c2 service nova] Acquiring lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62ef1516-0f0d-44e1-8dba-a888f392b555 req-c1d62cf2-eee2-4051-9de8-57e0f60b43c2 service nova] Acquired lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-62ef1516-0f0d-44e1-8dba-a888f392b555 req-c1d62cf2-eee2-4051-9de8-57e0f60b43c2 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:48:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-62ef1516-0f0d-44e1-8dba-a888f392b555 req-c1d62cf2-eee2-4051-9de8-57e0f60b43c2 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updated VIF entry in instance network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:48:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-62ef1516-0f0d-44e1-8dba-a888f392b555 req-c1d62cf2-eee2-4051-9de8-57e0f60b43c2 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating instance_info_cache with network_info: [{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62ef1516-0f0d-44e1-8dba-a888f392b555 req-c1d62cf2-eee2-4051-9de8-57e0f60b43c2 service nova] Releasing lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:48:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:48 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:48:49 user nova-compute[73052]: INFO nova.compute.claims [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Claim successful on node user
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:49 user nova-compute[73052]: INFO nova.compute.manager [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attaching volume 505b303e-d62f-48d3-9f76-966acbcb8643 to /dev/vdb
Aug 26 14:48:49 user nova-compute[73052]: DEBUG os_brick.utils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94b9a3-2836-4d89-af96-c4449b8d9f6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f7cd77-2613-4a0a-9ba0-b52bf3850883]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75dd453-d97d-440f-80f7-0a36e2c50e64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc7f49a-a36f-4ad8-935d-29d0af620264]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:48:49 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6534ed-d4d2-4312-945a-4eea29372b6b]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG os_brick.utils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating existing volume attachment record: fc700fb6-535b-479d-9ed3-ca3cfd55b998 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:48:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.policy [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '966347969be04bb9a69cbdc441a94d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6426cc5de72e40e4ba4570304328a568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:48:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Creating image(s)
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.236s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:50 user nova-compute[73052]: INFO nova.compute.manager [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Rebooting instance
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquired lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.210s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk 1073741824" returned: 0 in 0.059s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Successfully created port: d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.231s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Cannot resize image /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Ensure instance console log exists: /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating instance_info_cache with network_info: [{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Releasing lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Successfully updated port: d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquired lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e253173-1ebf-4765-a685-e7d9312f2b96 req-cfeedc83-3bc7-43ca-b485-e5905cde140d service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-changed-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e253173-1ebf-4765-a685-e7d9312f2b96 req-cfeedc83-3bc7-43ca-b485-e5905cde140d service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Refreshing instance network info cache due to event network-changed-d42c2dcf-f8f8-4178-a32b-faea50050dcf. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e253173-1ebf-4765-a685-e7d9312f2b96 req-cfeedc83-3bc7-43ca-b485-e5905cde140d service nova] Acquiring lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-7625bccf-906a-4b72-bc0a-e3331ae52a30 req-bd34b517-2982-45b1-bacb-4a687f192536 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-unplugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7625bccf-906a-4b72-bc0a-e3331ae52a30 req-bd34b517-2982-45b1-bacb-4a687f192536 service nova] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7625bccf-906a-4b72-bc0a-e3331ae52a30 req-bd34b517-2982-45b1-bacb-4a687f192536 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7625bccf-906a-4b72-bc0a-e3331ae52a30 req-bd34b517-2982-45b1-bacb-4a687f192536 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-7625bccf-906a-4b72-bc0a-e3331ae52a30 req-bd34b517-2982-45b1-bacb-4a687f192536 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] No waiting events found dispatching network-vif-unplugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:51 user nova-compute[73052]: WARNING nova.compute.manager [req-7625bccf-906a-4b72-bc0a-e3331ae52a30 req-bd34b517-2982-45b1-bacb-4a687f192536 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received unexpected event network-vif-unplugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Releasing lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance network_info: |[{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e253173-1ebf-4765-a685-e7d9312f2b96 req-cfeedc83-3bc7-43ca-b485-e5905cde140d service nova] Acquired lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e253173-1ebf-4765-a685-e7d9312f2b96 req-cfeedc83-3bc7-43ca-b485-e5905cde140d service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Refreshing network info cache for port d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Start _get_guest_xml network_info=[{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:48:51 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:51 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:48:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-883597149',display_name='tempest-ServerRescueNegativeTestJSON-server-883597149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-883597149',id=23,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCDGw/VQjctZ1orDhsFcUzz7rd/4Dd1cG8YisvxzGO2T2XqjX2DilbipG80gJz39D6Eje9bPcXWrWRK9h0UFTmKk1+Lj9whfIwlTyfyDx3BokkGHMhW57eBG0HpzhnvSQ==',key_name='tempest-keypair-672801022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-enh4hvpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='966347969be04bb9a69cbdc441a94d8f',uuid=2b3a3e44-b6be-4d68-b034-843d74ba9334,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:26,bridge_name='br-int',has_traffic_filtering=True,id=d42c2dcf-f8f8-4178-a32b-faea50050dcf,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c2dcf-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:48:52 user nova-compute[73052]:   <uuid>2b3a3e44-b6be-4d68-b034-843d74ba9334</uuid>
Aug 26 14:48:52 user nova-compute[73052]:   <name>instance-00000017</name>
Aug 26 14:48:52 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:48:52 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:48:52 user nova-compute[73052]:   <metadata>
Aug 26 14:48:52 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:48:52 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:48:52 user nova-compute[73052]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-883597149</nova:name>
Aug 26 14:48:52 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:48:51</nova:creationTime>
Aug 26 14:48:52 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:48:52 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:48:52 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:48:52 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:48:52 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:48:52 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:48:52 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:48:52 user nova-compute[73052]:       <nova:owner>
Aug 26 14:48:52 user nova-compute[73052]:         <nova:user uuid="966347969be04bb9a69cbdc441a94d8f">tempest-ServerRescueNegativeTestJSON-2104819576-project-member</nova:user>
Aug 26 14:48:52 user nova-compute[73052]:         <nova:project uuid="6426cc5de72e40e4ba4570304328a568">tempest-ServerRescueNegativeTestJSON-2104819576</nova:project>
Aug 26 14:48:52 user nova-compute[73052]:       </nova:owner>
Aug 26 14:48:52 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:48:52 user nova-compute[73052]:       <nova:ports>
Aug 26 14:48:52 user nova-compute[73052]:         <nova:port uuid="d42c2dcf-f8f8-4178-a32b-faea50050dcf">
Aug 26 14:48:52 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 14:48:52 user nova-compute[73052]:         </nova:port>
Aug 26 14:48:52 user nova-compute[73052]:       </nova:ports>
Aug 26 14:48:52 user nova-compute[73052]:     </nova:instance>
Aug 26 14:48:52 user nova-compute[73052]:   </metadata>
Aug 26 14:48:52 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:48:52 user nova-compute[73052]:     <system>
Aug 26 14:48:52 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:48:52 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:48:52 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:48:52 user nova-compute[73052]:       <entry name="serial">2b3a3e44-b6be-4d68-b034-843d74ba9334</entry>
Aug 26 14:48:52 user nova-compute[73052]:       <entry name="uuid">2b3a3e44-b6be-4d68-b034-843d74ba9334</entry>
Aug 26 14:48:52 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:48:52 user nova-compute[73052]:     </system>
Aug 26 14:48:52 user nova-compute[73052]:   </sysinfo>
Aug 26 14:48:52 user nova-compute[73052]:   <os>
Aug 26 14:48:52 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:48:52 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:48:52 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:48:52 user nova-compute[73052]:   </os>
Aug 26 14:48:52 user nova-compute[73052]:   <features>
Aug 26 14:48:52 user nova-compute[73052]:     <acpi/>
Aug 26 14:48:52 user nova-compute[73052]:     <apic/>
Aug 26 14:48:52 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:48:52 user nova-compute[73052]:   </features>
Aug 26 14:48:52 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:48:52 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:48:52 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:48:52 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:48:52 user nova-compute[73052]:   </clock>
Aug 26 14:48:52 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:48:52 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:48:52 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:48:52 user nova-compute[73052]:   </cpu>
Aug 26 14:48:52 user nova-compute[73052]:   <devices>
Aug 26 14:48:52 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:48:52 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:48:52 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk"/>
Aug 26 14:48:52 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:48:52 user nova-compute[73052]:     </disk>
Aug 26 14:48:52 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:48:52 user nova-compute[73052]:       <mac address="fa:16:3e:17:bc:26"/>
Aug 26 14:48:52 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:48:52 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:48:52 user nova-compute[73052]:       <target dev="tapd42c2dcf-f8"/>
Aug 26 14:48:52 user nova-compute[73052]:     </interface>
Aug 26 14:48:52 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:48:52 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/console.log" append="off"/>
Aug 26 14:48:52 user nova-compute[73052]:     </serial>
Aug 26 14:48:52 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:48:52 user nova-compute[73052]:     <video>
Aug 26 14:48:52 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:48:52 user nova-compute[73052]:     </video>
Aug 26 14:48:52 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:48:52 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:48:52 user nova-compute[73052]:     </rng>
Aug 26 14:48:52 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:48:52 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:48:52 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:48:52 user nova-compute[73052]:     </memballoon>
Aug 26 14:48:52 user nova-compute[73052]:   </devices>
Aug 26 14:48:52 user nova-compute[73052]: </domain>
Aug 26 14:48:52 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-883597149',display_name='tempest-ServerRescueNegativeTestJSON-server-883597149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-883597149',id=23,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCDGw/VQjctZ1orDhsFcUzz7rd/4Dd1cG8YisvxzGO2T2XqjX2DilbipG80gJz39D6Eje9bPcXWrWRK9h0UFTmKk1+Lj9whfIwlTyfyDx3BokkGHMhW57eBG0HpzhnvSQ==',key_name='tempest-keypair-672801022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-enh4hvpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='966347969be04bb9a69cbdc441a94d8f',uuid=2b3a3e44-b6be-4d68-b034-843d74ba9334,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:26,bridge_name='br-int',has_traffic_filtering=True,id=d42c2dcf-f8f8-4178-a32b-faea50050dcf,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c2dcf-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_vif [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:26,bridge_name='br-int',has_traffic_filtering=True,id=d42c2dcf-f8f8-4178-a32b-faea50050dcf,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c2dcf-f8') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:48:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Instance destroyed successfully.
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'resources' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd42c2dcf-f8, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd42c2dcf-f8, col_values=(('external_ids', {'iface-id': 'd42c2dcf-f8f8-4178-a32b-faea50050dcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:bc:26', 'vm-uuid': '2b3a3e44-b6be-4d68-b034-843d74ba9334'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1176116480',display_name='tempest-TestMinimumBasicScenario-server-1176116480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1176116480',id=18,image_ref='34627f75-187c-44f2-9749-4cc1345cfced',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAMSIyDQ1VQy6BQTJ0WjR355nHpIHxZhWS7n7EqmhMZh7KAKhqSTSs8c0BrvxrQWpXyJiDHkm6unDULTP4wmzzGpXNR641qX59KqYrTwsK1Es0nLuwmp1AY4EAqHHQW7g==',key_name='tempest-TestMinimumBasicScenario-560329351',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-x02axkt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34627f75-187c-44f2-9749-4cc1345cfced',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:48:51Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=c35499ba-06cb-443c-b019-5d3f9ea4c04c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_vif [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:52 user nova-compute[73052]: INFO os_vif [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:26,bridge_name='br-int',has_traffic_filtering=True,id=d42c2dcf-f8f8-4178-a32b-faea50050dcf,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c2dcf-f8')
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4db9d139-2d, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:52 user nova-compute[73052]: INFO os_vif [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d')
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKseBUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea19aba-5565-44dc-8d8e-5e9d7aa4e8e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No VIF found with MAC fa:16:3e:17:bc:26, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9412c3e5-6cde-4dca-9a88-ded1c31ecb94]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:52 user nova-compute[73052]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:52 user nova-compute[73052]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0184040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d215e2e-b626-401f-83e6-1564cb53fef3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71f6b4-77c7-4e6d-a997-5e59decc520b]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f82182-4269-420d-9076-ba6fdf0aa6ac]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8828031b-5522-4d45-82e0-25e41e129a44]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d5465b-2e61-41e3-b488-2fac2cec9dc8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[718f87f0-76ac-4a68-98fb-8c573fc47e6d]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260]
Aug 26 14:48:52 user nova-compute[73052]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260] successful.
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d127097a-b363-407a-95df-62d96b6d8165]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] <== disconnect_volume: return (322ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Start _get_guest_xml network_info=[{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=34627f75-187c-44f2-9749-4cc1345cfced,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '34627f75-187c-44f2-9749-4cc1345cfced'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '0f33ca40-6758-4c2b-bcbb-b48a2a6213e2', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKseBUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c35499ba-06cb-443c-b019-5d3f9ea4c04c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5d8e6df-0e5b-4ac9-b439-8813018e0fc7', 'serial': 'b5d8e6df-0e5b-4ac9-b439-8813018e0fc7'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:48:52 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:52 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=34627f75-187c-44f2-9749-4cc1345cfced,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'vcpu_model' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.objects.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Object Instance<c35499ba-06cb-443c-b019-5d3f9ea4c04c> lazy-loaded attributes: resources,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKseBUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:48:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:48:52 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e253173-1ebf-4765-a685-e7d9312f2b96 req-cfeedc83-3bc7-43ca-b485-e5905cde140d service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updated VIF entry in instance network info cache for port d42c2dcf-f8f8-4178-a32b-faea50050dcf. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e253173-1ebf-4765-a685-e7d9312f2b96 req-cfeedc83-3bc7-43ca-b485-e5905cde140d service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b0f99-3981-4509-8ce2-91bd7b40fcda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:48:52 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e253173-1ebf-4765-a685-e7d9312f2b96 req-cfeedc83-3bc7-43ca-b485-e5905cde140d service nova] Releasing lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[15200499-d6ee-4980-bdda-58dbeeded23f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7] added
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad5ed62-b128-47e5-ac79-846e3978a42c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24d763b-a7a8-44a0-b51a-b0ec3e2e3375]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKseBUIZ {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKseBUIZ" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f621b95b-e38c-4606-9708-281140b11ebf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EKseBUIZ'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d9fd3-a04c-4fa9-8a35-43e833783937]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bea422-564b-43ea-9f2a-82b258ee28cf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbf7787-d894-47ca-86f9-92dc3068b60e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260]
Aug 26 14:48:52 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260] successful.
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd53e3cb-7ef9-4788-b8a4-1f6475c122f5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ffd35f-aaa1-4c8f-bf6c-2a4f7ecbfc98]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:52 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:48:52 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:48:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[90903b40-f2de-44ec-bdbe-c6cf09b53d1a]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:48:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-6d7974a1-e276-4645-b9cc-8f15ee2446ed req-e04ce0ec-fc4b-45f8-b9b1-ae9192201fbf service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6d7974a1-e276-4645-b9cc-8f15ee2446ed req-e04ce0ec-fc4b-45f8-b9b1-ae9192201fbf service nova] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6d7974a1-e276-4645-b9cc-8f15ee2446ed req-e04ce0ec-fc4b-45f8-b9b1-ae9192201fbf service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6d7974a1-e276-4645-b9cc-8f15ee2446ed req-e04ce0ec-fc4b-45f8-b9b1-ae9192201fbf service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-6d7974a1-e276-4645-b9cc-8f15ee2446ed req-e04ce0ec-fc4b-45f8-b9b1-ae9192201fbf service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] No waiting events found dispatching network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:53 user nova-compute[73052]: WARNING nova.compute.manager [req-6d7974a1-e276-4645-b9cc-8f15ee2446ed req-e04ce0ec-fc4b-45f8-b9b1-ae9192201fbf service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received unexpected event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 14:48:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKseBUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23430316565333734', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:48:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430316565333734', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1176116480',display_name='tempest-TestMinimumBasicScenario-server-1176116480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1176116480',id=18,image_ref='34627f75-187c-44f2-9749-4cc1345cfced',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAMSIyDQ1VQy6BQTJ0WjR355nHpIHxZhWS7n7EqmhMZh7KAKhqSTSs8c0BrvxrQWpXyJiDHkm6unDULTP4wmzzGpXNR641qX59KqYrTwsK1Es0nLuwmp1AY4EAqHHQW7g==',key_name='tempest-TestMinimumBasicScenario-560329351',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-x02axkt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34627f75-187c-44f2-9749-4cc1345cfced',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:48:51Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=c35499ba-06cb-443c-b019-5d3f9ea4c04c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'pci_devices' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.objects.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Object Instance<c35499ba-06cb-443c-b019-5d3f9ea4c04c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:48:54 user nova-compute[73052]:   <uuid>c35499ba-06cb-443c-b019-5d3f9ea4c04c</uuid>
Aug 26 14:48:54 user nova-compute[73052]:   <name>instance-00000012</name>
Aug 26 14:48:54 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:48:54 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:48:54 user nova-compute[73052]:   <metadata>
Aug 26 14:48:54 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:48:54 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:48:54 user nova-compute[73052]:       <nova:name>tempest-TestMinimumBasicScenario-server-1176116480</nova:name>
Aug 26 14:48:54 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:48:52</nova:creationTime>
Aug 26 14:48:54 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:48:54 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:48:54 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:48:54 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:48:54 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:48:54 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:48:54 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:48:54 user nova-compute[73052]:       <nova:owner>
Aug 26 14:48:54 user nova-compute[73052]:         <nova:user uuid="c5477383284f46df97949c64f6cc0021">tempest-TestMinimumBasicScenario-1910985391-project-member</nova:user>
Aug 26 14:48:54 user nova-compute[73052]:         <nova:project uuid="a7454d6d00cc4165b90d29aeea11067b">tempest-TestMinimumBasicScenario-1910985391</nova:project>
Aug 26 14:48:54 user nova-compute[73052]:       </nova:owner>
Aug 26 14:48:54 user nova-compute[73052]:       <nova:root type="image" uuid="34627f75-187c-44f2-9749-4cc1345cfced"/>
Aug 26 14:48:54 user nova-compute[73052]:       <nova:ports>
Aug 26 14:48:54 user nova-compute[73052]:         <nova:port uuid="4db9d139-2df5-4482-9ff6-67939e0d9a32">
Aug 26 14:48:54 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 14:48:54 user nova-compute[73052]:         </nova:port>
Aug 26 14:48:54 user nova-compute[73052]:       </nova:ports>
Aug 26 14:48:54 user nova-compute[73052]:     </nova:instance>
Aug 26 14:48:54 user nova-compute[73052]:   </metadata>
Aug 26 14:48:54 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:48:54 user nova-compute[73052]:     <system>
Aug 26 14:48:54 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:48:54 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:48:54 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:48:54 user nova-compute[73052]:       <entry name="serial">c35499ba-06cb-443c-b019-5d3f9ea4c04c</entry>
Aug 26 14:48:54 user nova-compute[73052]:       <entry name="uuid">c35499ba-06cb-443c-b019-5d3f9ea4c04c</entry>
Aug 26 14:48:54 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:48:54 user nova-compute[73052]:     </system>
Aug 26 14:48:54 user nova-compute[73052]:   </sysinfo>
Aug 26 14:48:54 user nova-compute[73052]:   <os>
Aug 26 14:48:54 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:48:54 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:48:54 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:48:54 user nova-compute[73052]:   </os>
Aug 26 14:48:54 user nova-compute[73052]:   <features>
Aug 26 14:48:54 user nova-compute[73052]:     <acpi/>
Aug 26 14:48:54 user nova-compute[73052]:     <apic/>
Aug 26 14:48:54 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:48:54 user nova-compute[73052]:   </features>
Aug 26 14:48:54 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:48:54 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:48:54 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:48:54 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:48:54 user nova-compute[73052]:   </clock>
Aug 26 14:48:54 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:48:54 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:48:54 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:48:54 user nova-compute[73052]:   </cpu>
Aug 26 14:48:54 user nova-compute[73052]:   <devices>
Aug 26 14:48:54 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:48:54 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:48:54 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk"/>
Aug 26 14:48:54 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:48:54 user nova-compute[73052]:     </disk>
Aug 26 14:48:54 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:48:54 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:48:54 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 14:48:54 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:48:54 user nova-compute[73052]:       <serial>b5d8e6df-0e5b-4ac9-b439-8813018e0fc7</serial>
Aug 26 14:48:54 user nova-compute[73052]:     </disk>
Aug 26 14:48:54 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:48:54 user nova-compute[73052]:       <mac address="fa:16:3e:1f:a8:07"/>
Aug 26 14:48:54 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:48:54 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:48:54 user nova-compute[73052]:       <target dev="tap4db9d139-2d"/>
Aug 26 14:48:54 user nova-compute[73052]:     </interface>
Aug 26 14:48:54 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:48:54 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/console.log" append="off"/>
Aug 26 14:48:54 user nova-compute[73052]:     </serial>
Aug 26 14:48:54 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:48:54 user nova-compute[73052]:     <video>
Aug 26 14:48:54 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:48:54 user nova-compute[73052]:     </video>
Aug 26 14:48:54 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:48:54 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:48:54 user nova-compute[73052]:     </rng>
Aug 26 14:48:54 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:48:54 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:48:54 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:48:54 user nova-compute[73052]:     </memballoon>
Aug 26 14:48:54 user nova-compute[73052]:   </devices>
Aug 26 14:48:54 user nova-compute[73052]: </domain>
Aug 26 14:48:54 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'trusted_certs' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.objects.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Object Instance<c35499ba-06cb-443c-b019-5d3f9ea4c04c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Cannot resize image /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'migration_context' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.objects.base [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Object Instance<c35499ba-06cb-443c-b019-5d3f9ea4c04c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1176116480',display_name='tempest-TestMinimumBasicScenario-server-1176116480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1176116480',id=18,image_ref='34627f75-187c-44f2-9749-4cc1345cfced',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAMSIyDQ1VQy6BQTJ0WjR355nHpIHxZhWS7n7EqmhMZh7KAKhqSTSs8c0BrvxrQWpXyJiDHkm6unDULTP4wmzzGpXNR641qX59KqYrTwsK1Es0nLuwmp1AY4EAqHHQW7g==',key_name='tempest-TestMinimumBasicScenario-560329351',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-x02axkt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34627f75-187c-44f2-9749-4cc1345cfced',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:48:51Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=c35499ba-06cb-443c-b019-5d3f9ea4c04c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG os_vif [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4db9d139-2d, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4db9d139-2d, col_values=(('external_ids', {'iface-id': '4db9d139-2df5-4482-9ff6-67939e0d9a32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:a8:07', 'vm-uuid': 'c35499ba-06cb-443c-b019-5d3f9ea4c04c'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:48:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:54 user nova-compute[73052]: INFO os_vif [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d')
Aug 26 14:48:55 user nova-compute[73052]: DEBUG nova.compute.manager [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:55 user nova-compute[73052]: DEBUG nova.compute.manager [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:55 user nova-compute[73052]: WARNING nova.compute.manager [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state building and task_state spawning.
Aug 26 14:48:55 user nova-compute[73052]: DEBUG nova.compute.manager [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:55 user nova-compute[73052]: DEBUG nova.compute.manager [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:55 user nova-compute[73052]: WARNING nova.compute.manager [req-cf7075d4-eccc-46d3-8fcf-2a3550686d92 req-adbfd081-d5d2-482a-a729-86300efa5d3c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state building and task_state spawning.
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061336.321566, 2b3a3e44-b6be-4d68-b034-843d74ba9334 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:56 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] VM Resumed (Lifecycle Event)
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:48:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance spawned successfully.
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:48:56 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061336.3275974, 2b3a3e44-b6be-4d68-b034-843d74ba9334 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:56 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] VM Started (Lifecycle Event)
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:48:56 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:48:56 user nova-compute[73052]: INFO nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Took 6.61 seconds to spawn the instance on the hypervisor.
Aug 26 14:48:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:56 user nova-compute[73052]: INFO nova.compute.manager [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Took 7.64 seconds to build instance.
Aug 26 14:48:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e269b55e-2802-4313-80e5-eef6c61c583d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.772s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] No waiting events found dispatching network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:57 user nova-compute[73052]: WARNING nova.compute.manager [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received unexpected event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 14:48:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] No waiting events found dispatching network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:48:57 user nova-compute[73052]: WARNING nova.compute.manager [req-7053bb4e-58be-46bd-ae5f-453f82cc5ff1 req-1801a6b1-5165-4f4f-b11a-4bacfe714608 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received unexpected event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:48:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:48:58 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating instance_info_cache with network_info: [{"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:48:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:48:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for c35499ba-06cb-443c-b019-5d3f9ea4c04c due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061339.1340597, c35499ba-06cb-443c-b019-5d3f9ea4c04c => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:59 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] VM Resumed (Lifecycle Event)
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:48:59 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Instance rebooted successfully.
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:48:59 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061339.1355073, c35499ba-06cb-443c-b019-5d3f9ea4c04c => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:48:59 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] VM Started (Lifecycle Event)
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-306e06e3-fa2d-41b3-b88e-ca00c6388a5f tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.993s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:48:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:49:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:49:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:49:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:49:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:02 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.282s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwDugmax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:49:04 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:49:04 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:49:04 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d5d5a-37b2-44c7-a794-63ccc2172077]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:49:04 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4522bf9c-9b5c-4142-bc26-2207fbc79be3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643] added
Aug 26 14:49:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c38ca4-cdea-41f5-9527-275c20e05074]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe31065-90a2-4f96-987e-cf939a974a15]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwDugmax {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwDugmax" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d3cb2-ebe7-4ea1-8184-15f36938a89a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PwDugmax'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac07e922-c458-42e3-ac89-6fbbf853c0df]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8641880c-20b0-4bf2-a423-4088d9599dbe]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:04 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:04 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd944c4-8fc1-40c4-a6df-59f45b542e80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643, portal: 172.16.0.220,3260]
Aug 26 14:49:04 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643, portal: 172.16.0.220,3260] successful.
Aug 26 14:49:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9804576-d16b-4066-a1a3-f196fba11529]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d6730-847e-4809-81d1-fcc3105c5acf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:04 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:04 user nova-compute[73052]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 (non-flash)
Aug 26 14:49:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:04 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:04 user nova-compute[73052]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 (non-flash)
Aug 26 14:49:04 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2729be14-6aab-4f41-b8b9-b87a75ced653]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwDugmax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "79922a3f-53e3-4d29-8000-902e986e30c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "79922a3f-53e3-4d29-8000-902e986e30c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:04 user nova-compute[73052]: INFO nova.compute.manager [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Terminating instance
Aug 26 14:49:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-cceccdab-0398-4318-a1cb-eb0ce219efca req-1f9d7e40-bb1d-4f31-af7a-247578852ee6 service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received event network-vif-unplugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cceccdab-0398-4318-a1cb-eb0ce219efca req-1f9d7e40-bb1d-4f31-af7a-247578852ee6 service nova] Acquiring lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cceccdab-0398-4318-a1cb-eb0ce219efca req-1f9d7e40-bb1d-4f31-af7a-247578852ee6 service nova] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cceccdab-0398-4318-a1cb-eb0ce219efca req-1f9d7e40-bb1d-4f31-af7a-247578852ee6 service nova] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-cceccdab-0398-4318-a1cb-eb0ce219efca req-1f9d7e40-bb1d-4f31-af7a-247578852ee6 service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] No waiting events found dispatching network-vif-unplugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-cceccdab-0398-4318-a1cb-eb0ce219efca req-1f9d7e40-bb1d-4f31-af7a-247578852ee6 service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received event network-vif-unplugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.526s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '26333343536343663', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333343536343663', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:49:05 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:49:05 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:49:05 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:49:05 user nova-compute[73052]:   <serial>505b303e-d62f-48d3-9f76-966acbcb8643</serial>
Aug 26 14:49:05 user nova-compute[73052]: </disk>
Aug 26 14:49:05 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:49:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:06 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Instance destroyed successfully.
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lazy-loading 'resources' on Instance uuid 79922a3f-53e3-4d29-8000-902e986e30c0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-811964041',display_name='tempest-ServersNegativeTestJSON-server-811964041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-811964041',id=1,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bbaaf64cd44c06b2c1ef28d17c28cb',ramdisk_id='',reservation_id='r-4nbwvh1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-618175231',owner_user_name='tempest-ServersNegativeTestJSON-618175231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:40:13Z,user_data=None,user_id='321c53c447cb491585e8eb540b0f4157',uuid=79922a3f-53e3-4d29-8000-902e986e30c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converting VIF {"id": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "address": "fa:16:3e:af:51:61", "network": {"id": "5847e731-b0d1-484c-bc2e-e44c5e23d643", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-975916462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bbaaf64cd44c06b2c1ef28d17c28cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903800ed-8b", "ovs_interfaceid": "903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:51:61,bridge_name='br-int',has_traffic_filtering=True,id=903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903800ed-8b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG os_vif [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:51:61,bridge_name='br-int',has_traffic_filtering=True,id=903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903800ed-8b') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903800ed-8b, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:49:06 user nova-compute[73052]: INFO os_vif [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:51:61,bridge_name='br-int',has_traffic_filtering=True,id=903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f,network=Network(5847e731-b0d1-484c-bc2e-e44c5e23d643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903800ed-8b')
Aug 26 14:49:06 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Deleting instance files /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0_del
Aug 26 14:49:06 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Deletion of /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0_del complete
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No VIF found with MAC fa:16:3e:51:e9:f0, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:49:06 user nova-compute[73052]: INFO nova.compute.manager [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Took 1.52 seconds to destroy the instance on the hypervisor.
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json" returned: 1 in 0.213s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk --force-share --output=json' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:49:06 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000001, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/79922a3f-53e3-4d29-8000-902e986e30c0/disk
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d328954e-f92a-48f0-877b-9b48baac8b84 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.358s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:49:07 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Took 0.77 seconds to deallocate network for instance.
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-b5886bb3-3ead-4bc0-8f87-c6373e773020 req-0742d77c-5def-4480-87ca-63a83d72929d service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received event network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5886bb3-3ead-4bc0-8f87-c6373e773020 req-0742d77c-5def-4480-87ca-63a83d72929d service nova] Acquiring lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5886bb3-3ead-4bc0-8f87-c6373e773020 req-0742d77c-5def-4480-87ca-63a83d72929d service nova] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5886bb3-3ead-4bc0-8f87-c6373e773020 req-0742d77c-5def-4480-87ca-63a83d72929d service nova] Lock "79922a3f-53e3-4d29-8000-902e986e30c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-b5886bb3-3ead-4bc0-8f87-c6373e773020 req-0742d77c-5def-4480-87ca-63a83d72929d service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] No waiting events found dispatching network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:07 user nova-compute[73052]: WARNING nova.compute.manager [req-b5886bb3-3ead-4bc0-8f87-c6373e773020 req-0742d77c-5def-4480-87ca-63a83d72929d service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received unexpected event network-vif-plugged-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f for instance with vm_state deleted and task_state None.
Aug 26 14:49:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-b5886bb3-3ead-4bc0-8f87-c6373e773020 req-0742d77c-5def-4480-87ca-63a83d72929d service nova] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Received event network-vif-deleted-903800ed-8bfc-4a30-b7f4-4db8ebf6cf9f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.748s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:08 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Deleted allocations for instance 79922a3f-53e3-4d29-8000-902e986e30c0
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c42fd53-558d-4c29-a929-49a3b048845d tempest-ServersNegativeTestJSON-618175231 tempest-ServersNegativeTestJSON-618175231-project-member] Lock "79922a3f-53e3-4d29-8000-902e986e30c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.430s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:08 user nova-compute[73052]: INFO nova.compute.manager [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Detaching volume 505b303e-d62f-48d3-9f76-966acbcb8643
Aug 26 14:49:08 user nova-compute[73052]: INFO nova.virt.block_device [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attempting to driver detach volume 505b303e-d62f-48d3-9f76-966acbcb8643 from mountpoint /dev/vdb
Aug 26 14:49:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Attempting to detach device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:49:08 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:49:08 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:49:08 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:49:08 user nova-compute[73052]:   <serial>505b303e-d62f-48d3-9f76-966acbcb8643</serial>
Aug 26 14:49:08 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:49:08 user nova-compute[73052]: </disk>
Aug 26 14:49:08 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:49:08 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully detached device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the persistent domain config.
Aug 26 14:49:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:49:08 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:49:08 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:49:08 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:49:08 user nova-compute[73052]:   <serial>505b303e-d62f-48d3-9f76-966acbcb8643</serial>
Aug 26 14:49:08 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:49:08 user nova-compute[73052]: </disk>
Aug 26 14:49:08 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061349.268495, 92558f0f-dc80-4acf-b3b9-27d0244c0ddb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully detached device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the live domain config.
Aug 26 14:49:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:49:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:49:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7005MB free_disk=25.289352416992188GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG nova.objects.instance [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'flavor' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwDugmax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:49:09 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:49:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b849f10a-b231-4ef8-987a-3ee3e85a4c24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[486bc80b-cd30-4021-adfb-6d23290b083a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:09 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:09 user nova-compute[73052]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 (non-flash)
Aug 26 14:49:09 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:09 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:09 user nova-compute[73052]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 (non-flash)
Aug 26 14:49:09 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0444040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd81d51-a32d-46c2-b27f-cb1664ee37d1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd2fb6a-71d2-47ab-b6e3-9cf4adaad99f]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[84969bea-9936-41b3-8899-50e4256767f2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7e88d68a-33cf-467a-9e55-8162648a2b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c35499ba-06cb-443c-b019-5d3f9ea4c04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 86d43ddf-d653-4771-9d24-4c3617664337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e036233c-9812-4f01-a74b-bdfd6ca23b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ade6b4-76bf-4803-8c36-47411db92b43]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4be1c-9aa1-46b7-92ed-1854c2b49b15]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:10 user nova-compute[73052]: INFO nova.compute.manager [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Attaching volume 1657e423-afb0-40aa-b1eb-9ce6ff3148ad to /dev/vdb
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a664d4-72bc-447d-9227-4c5ad3a3fea3]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643, portal: 172.16.0.220,3260]
Aug 26 14:49:10 user nova-compute[73052]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643, portal: 172.16.0.220,3260] successful.
Aug 26 14:49:10 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:505b303e-d62f-48d3-9f76-966acbcb8643 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7ac71b-6b08-4138-855d-5119e859b048]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== disconnect_volume: return (379ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.utils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7027e7-61c5-49b1-a454-6c8f9c2e6fcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.035s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[11db3e34-4540-4a19-a005-7b8be0e5d8f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f7a99e-4a7d-4e6f-8687-3ad7354d79d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ecbb1f-9862-4dea-9217-d7b91d4085ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:49:10 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35917b0-31a9-4604-a0a5-1ae15a82bfa2]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG os_brick.utils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating existing volume attachment record: 8fda75db-8b5a-4b43-890c-deaada4dd27b {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:49:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.820s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:11 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a02f6624-cfed-4a61-991f-53fc2fc31c5c tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.586s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:21 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061346.2158792, 79922a3f-53e3-4d29-8000-902e986e30c0 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:49:21 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] VM Stopped (Lifecycle Event)
Aug 26 14:49:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-830d4895-ad6e-4190-acb6-d3f4762636b8 None None] [instance: 79922a3f-53e3-4d29-8000-902e986e30c0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIKdwuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:49:22 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:49:22 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:49:22 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8e2d56-0cdc-46cd-bedd-c918ebb23f19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:49:22 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a6e036-703a-4dfd-87c6-f5fbcfcb8d71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad] added
Aug 26 14:49:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c3dbc-590f-4922-ac49-d60efdec51ea]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa08f61-3a16-41c4-9684-426fa2a267c3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIKdwuJE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIKdwuJE" returned: 0 in 0.036s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef41ad42-a3ae-4d51-82d0-a664589039d0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VIKdwuJE'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c40846f-41bb-4890-9d99-2be0ea1b91a5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1bb9b7-c5a9-4aa0-ab83-99373c57dec4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:22 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:22 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a6fc1-3837-43bb-9991-75263139e846]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad, portal: 172.16.0.220,3260]
Aug 26 14:49:22 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad, portal: 172.16.0.220,3260] successful.
Aug 26 14:49:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd2ba5-a6d5-4baa-a48c-3755f7debacb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec1ef85-455a-4556-a3e9-ce76f47f6d38]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:22 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:22 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:49:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:22 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:22 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:49:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e2982-6fcb-4803-bb93-6a4f0d9d0da2]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIKdwuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23838366465646535', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838366465646535', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG nova.objects.instance [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'flavor' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:49:23 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:49:23 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:49:23 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:49:23 user nova-compute[73052]:   <serial>1657e423-afb0-40aa-b1eb-9ce6ff3148ad</serial>
Aug 26 14:49:23 user nova-compute[73052]: </disk>
Aug 26 14:49:23 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:49:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No VIF found with MAC fa:16:3e:c1:d7:cd, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:49:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1b119c7d-c011-4547-ad67-2dcd1c26bcf1 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.854s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:24 user nova-compute[73052]: INFO nova.compute.manager [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Rescuing
Aug 26 14:49:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:49:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquired lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:49:24 user nova-compute[73052]: DEBUG nova.network.neutron [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:49:25 user nova-compute[73052]: DEBUG nova.network.neutron [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:49:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Releasing lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:49:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-9a1b47b4-918f-4307-b75f-016624c49941 req-7711845f-330a-4302-a007-a1aeed44b902 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9a1b47b4-918f-4307-b75f-016624c49941 req-7711845f-330a-4302-a007-a1aeed44b902 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9a1b47b4-918f-4307-b75f-016624c49941 req-7711845f-330a-4302-a007-a1aeed44b902 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9a1b47b4-918f-4307-b75f-016624c49941 req-7711845f-330a-4302-a007-a1aeed44b902 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-9a1b47b4-918f-4307-b75f-016624c49941 req-7711845f-330a-4302-a007-a1aeed44b902 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:26 user nova-compute[73052]: WARNING nova.compute.manager [req-9a1b47b4-918f-4307-b75f-016624c49941 req-7711845f-330a-4302-a007-a1aeed44b902 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state active and task_state rescuing.
Aug 26 14:49:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance destroyed successfully.
Aug 26 14:49:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Attempting a stable device rescue
Aug 26 14:49:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73052) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance directory exists: not creating {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 14:49:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Creating image(s)
Aug 26 14:49:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG nova.objects.instance [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "d53d65365c7f677b8481925c3eee9a9b5c59f8aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "d53d65365c7f677b8481925c3eee9a9b5c59f8aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:27 user nova-compute[73052]: DEBUG nova.compute.manager [req-2207d86b-29c9-4c67-8641-3a58f6f5eddf req-49a2156a-cbed-4a02-965b-b3c247d2e1d3 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-changed-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:27 user nova-compute[73052]: DEBUG nova.compute.manager [req-2207d86b-29c9-4c67-8641-3a58f6f5eddf req-49a2156a-cbed-4a02-965b-b3c247d2e1d3 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Refreshing instance network info cache due to event network-changed-25613dee-a11d-49c8-aeba-808b01197e7a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:49:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2207d86b-29c9-4c67-8641-3a58f6f5eddf req-49a2156a-cbed-4a02-965b-b3c247d2e1d3 service nova] Acquiring lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:49:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2207d86b-29c9-4c67-8641-3a58f6f5eddf req-49a2156a-cbed-4a02-965b-b3c247d2e1d3 service nova] Acquired lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:49:27 user nova-compute[73052]: DEBUG nova.network.neutron [req-2207d86b-29c9-4c67-8641-3a58f6f5eddf req-49a2156a-cbed-4a02-965b-b3c247d2e1d3 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Refreshing network info cache for port 25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-9ca5eb4f-6f36-419f-a7c4-80b7f29b7ea6 req-a44b6781-94b8-4728-8e67-eb0f59a5a714 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9ca5eb4f-6f36-419f-a7c4-80b7f29b7ea6 req-a44b6781-94b8-4728-8e67-eb0f59a5a714 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9ca5eb4f-6f36-419f-a7c4-80b7f29b7ea6 req-a44b6781-94b8-4728-8e67-eb0f59a5a714 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9ca5eb4f-6f36-419f-a7c4-80b7f29b7ea6 req-a44b6781-94b8-4728-8e67-eb0f59a5a714 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-9ca5eb4f-6f36-419f-a7c4-80b7f29b7ea6 req-a44b6781-94b8-4728-8e67-eb0f59a5a714 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:28 user nova-compute[73052]: WARNING nova.compute.manager [req-9ca5eb4f-6f36-419f-a7c4-80b7f29b7ea6 req-a44b6781-94b8-4728-8e67-eb0f59a5a714 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state active and task_state rescuing.
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa.part --force-share --output=json" returned: 0 in 0.230s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG nova.virt.images [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] 17cdbb75-5c2b-4520-925c-6c06187c1196 was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa.part /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa.part /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa.converted" returned: 0 in 0.406s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-2207d86b-29c9-4c67-8641-3a58f6f5eddf req-49a2156a-cbed-4a02-965b-b3c247d2e1d3 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updated VIF entry in instance network info cache for port 25613dee-a11d-49c8-aeba-808b01197e7a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-2207d86b-29c9-4c67-8641-3a58f6f5eddf req-49a2156a-cbed-4a02-965b-b3c247d2e1d3 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating instance_info_cache with network_info: [{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2207d86b-29c9-4c67-8641-3a58f6f5eddf req-49a2156a-cbed-4a02-965b-b3c247d2e1d3 service nova] Releasing lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "d53d65365c7f677b8481925c3eee9a9b5c59f8aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.120s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "d53d65365c7f677b8481925c3eee9a9b5c59f8aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "d53d65365c7f677b8481925c3eee9a9b5c59f8aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa,backing_fmt=raw /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa,backing_fmt=raw /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue" returned: 0 in 0.049s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "d53d65365c7f677b8481925c3eee9a9b5c59f8aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'migration_context' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Object Instance<7e88d68a-33cf-467a-9e55-8162648a2b02> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Start _get_guest_xml network_info=[{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "vif_mac": "fa:16:3e:c1:d7:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '17cdbb75-5c2b-4520-925c-6c06187c1196', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '8fda75db-8b5a-4b43-890c-deaada4dd27b', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIKdwuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7e88d68a-33cf-467a-9e55-8162648a2b02', 'attached_at': '', 'detached_at': '', 'volume_id': '1657e423-afb0-40aa-b1eb-9ce6ff3148ad', 'serial': '1657e423-afb0-40aa-b1eb-9ce6ff3148ad'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'resources' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Object Instance<7e88d68a-33cf-467a-9e55-8162648a2b02> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Object Instance<7e88d68a-33cf-467a-9e55-8162648a2b02> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:49:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:49:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Object Instance<7e88d68a-33cf-467a-9e55-8162648a2b02> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIKdwuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:49:29 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:49:29 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:49:29 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8796505-f0d4-4e52-b288-4a7e95089e3d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VIKdwuJE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 14:49:29 user nova-compute[73052]: node.name = iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad
Aug 26 14:49:29 user nova-compute[73052]: node.tpgt = -1
Aug 26 14:49:29 user nova-compute[73052]: node.startup = automatic
Aug 26 14:49:29 user nova-compute[73052]: node.leading_login = No
Aug 26 14:49:29 user nova-compute[73052]: iface.iscsi_ifacename = default
Aug 26 14:49:29 user nova-compute[73052]: iface.net_ifacename = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.ipaddress = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.prefix_len = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.hwaddress = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.transport_name = tcp
Aug 26 14:49:29 user nova-compute[73052]: iface.initiatorname = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.state = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.vlan_id = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.vlan_priority = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.vlan_state = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.iface_num = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.mtu = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.port = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.bootproto = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.subnet_mask = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.gateway = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.dhcp_alt_client_id = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.dhcp_dns = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.dhcp_learn_iqn = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.dhcp_vendor_id_state = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.dhcp_vendor_id = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.dhcp_slp_da = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.fragmentation = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.gratuitous_arp = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.incoming_forwarding = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.tos_state = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.tos = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.ttl = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.delayed_ack = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.tcp_nagle = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.tcp_wsf_state = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.tcp_wsf = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.tcp_timer_scale = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.tcp_timestamp = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.redirect = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.def_task_mgmt_timeout = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.header_digest = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.data_digest = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.immediate_data = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.initial_r2t = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.data_seq_inorder = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.data_pdu_inorder = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.erl = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.max_receive_data_len = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.first_burst_len = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.max_outstanding_r2t = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.max_burst_len = 0
Aug 26 14:49:29 user nova-compute[73052]: iface.chap_auth = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.bidi_chap = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.strict_login_compliance = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.discovery_auth = <empty>
Aug 26 14:49:29 user nova-compute[73052]: iface.discovery_logout = <empty>
Aug 26 14:49:29 user nova-compute[73052]: node.discovery_address = <empty>
Aug 26 14:49:29 user nova-compute[73052]: node.discovery_port = 0
Aug 26 14:49:29 user nova-compute[73052]: node.discovery_type = static
Aug 26 14:49:29 user nova-compute[73052]: node.session.initial_cmdsn = 0
Aug 26 14:49:29 user nova-compute[73052]: node.session.initial_login_retry_max = 8
Aug 26 14:49:29 user nova-compute[73052]: node.session.xmit_thread_priority = -20
Aug 26 14:49:29 user nova-compute[73052]: node.session.cmds_max = 128
Aug 26 14:49:29 user nova-compute[73052]: node.session.queue_depth = 32
Aug 26 14:49:29 user nova-compute[73052]: node.session.nr_sessions = 1
Aug 26 14:49:29 user nova-compute[73052]: node.session.auth.authmethod = CHAP
Aug 26 14:49:29 user nova-compute[73052]: node.session.auth.username = VIKdwuJE
Aug 26 14:49:29 user nova-compute[73052]: node.session.auth.password = ***
Aug 26 14:49:29 user nova-compute[73052]: node.session.auth.username_in = <empty>
Aug 26 14:49:29 user nova-compute[73052]: node.session.auth.password_in = <empty>
Aug 26 14:49:29 user nova-compute[73052]: node.session.auth.chap_algs = MD5
Aug 26 14:49:29 user nova-compute[73052]: node.session.timeo.replacement_timeout = 120
Aug 26 14:49:29 user nova-compute[73052]: node.session.err_timeo.abort_timeout = 15
Aug 26 14:49:29 user nova-compute[73052]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 14:49:29 user nova-compute[73052]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 14:49:29 user nova-compute[73052]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.FastAbort = Yes
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.InitialR2T = No
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.ImmediateData = Yes
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.MaxConnections = 1
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 14:49:29 user nova-compute[73052]: node.session.iscsi.ERL = 0
Aug 26 14:49:29 user nova-compute[73052]: node.session.scan = manual
Aug 26 14:49:29 user nova-compute[73052]: node.session.reopen_max = 0
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].address = 172.16.0.220
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].port = 3260
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].startup = manual
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].tcp.window_size = 524288
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].tcp.type_of_service = 0
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].timeo.logout_timeout = 15
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].timeo.login_timeout = 15
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].timeo.auth_timeout = 45
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].iscsi.DataDigest = None
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].iscsi.IFMarker = No
Aug 26 14:49:29 user nova-compute[73052]: node.conn[0].iscsi.OFMarker = No
Aug 26 14:49:29 user nova-compute[73052]: # END RECORD
Aug 26 14:49:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[59900c68-25cc-46de-9c44-a0c14c4f7220]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bdeacc-2594-4cf1-9ea6-6bd706ebc9f0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIKdwuJE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIKdwuJE" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d79dd-f2b0-49bc-94a4-4daae295c0b5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VIKdwuJE'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[da53b1a7-58d5-488a-91ec-11a011ed70a8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[447d547b-e415-42e0-9be2-e88664a3a456]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:29 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:29 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:49:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:49:29 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:49:29 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:49:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] HCTL ('34', '0', '0', 0) found on session 23 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fe0e78-b993-4f52-9efa-f49ed2599444]: (4, ('0 0 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Searching for a device in session 23 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIKdwuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23838366465646535', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838366465646535', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1978096229',display_name='tempest-ServerStableDeviceRescueTest-server-1978096229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1978096229',id=16,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYl6zJKbt43Fyr9FOe8j13+xH2QHq8Iaym6cf5iO5DFrk/ua4JwD+Mi7UoN3tw1MVSdsO76B0Oh178aC7MsQRIg3HANtZM5pUTjd26VfvXyzWyzzNYuZOnjhaOuN+Cww==',key_name='tempest-keypair-1722362',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4564e9f65a9e4608a95bae156d64d4b0',ramdisk_id='',reservation_id='r-cfdfmddr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-848131570',owner_user_name='tempest-ServerStableDeviceRescueTest-848131570-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:47:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f7c01b6be324d92bdb021b34d2c011b',uuid=7e88d68a-33cf-467a-9e55-8162648a2b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "vif_mac": "fa:16:3e:c1:d7:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Converting VIF {"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "vif_mac": "fa:16:3e:c1:d7:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763,network=Network(d9ac1582-5175-4ca3-9ce2-0cc6451c5f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c81e0c-e3') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Object Instance<7e88d68a-33cf-467a-9e55-8162648a2b02> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:49:29 user nova-compute[73052]:   <uuid>7e88d68a-33cf-467a-9e55-8162648a2b02</uuid>
Aug 26 14:49:29 user nova-compute[73052]:   <name>instance-00000010</name>
Aug 26 14:49:29 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:49:29 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:49:29 user nova-compute[73052]:   <metadata>
Aug 26 14:49:29 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:49:29 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:49:29 user nova-compute[73052]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1978096229</nova:name>
Aug 26 14:49:29 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:49:29</nova:creationTime>
Aug 26 14:49:29 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:49:29 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:49:29 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:49:29 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:49:29 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:49:29 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:49:29 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:49:29 user nova-compute[73052]:       <nova:owner>
Aug 26 14:49:29 user nova-compute[73052]:         <nova:user uuid="7f7c01b6be324d92bdb021b34d2c011b">tempest-ServerStableDeviceRescueTest-848131570-project-member</nova:user>
Aug 26 14:49:29 user nova-compute[73052]:         <nova:project uuid="4564e9f65a9e4608a95bae156d64d4b0">tempest-ServerStableDeviceRescueTest-848131570</nova:project>
Aug 26 14:49:29 user nova-compute[73052]:       </nova:owner>
Aug 26 14:49:29 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:49:29 user nova-compute[73052]:       <nova:ports>
Aug 26 14:49:29 user nova-compute[73052]:         <nova:port uuid="d5c81e0c-e3d2-42e3-a444-a1730b6d4763">
Aug 26 14:49:29 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 14:49:29 user nova-compute[73052]:         </nova:port>
Aug 26 14:49:29 user nova-compute[73052]:       </nova:ports>
Aug 26 14:49:29 user nova-compute[73052]:     </nova:instance>
Aug 26 14:49:29 user nova-compute[73052]:   </metadata>
Aug 26 14:49:29 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:49:29 user nova-compute[73052]:     <system>
Aug 26 14:49:29 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:49:29 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:49:29 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:49:29 user nova-compute[73052]:       <entry name="serial">7e88d68a-33cf-467a-9e55-8162648a2b02</entry>
Aug 26 14:49:29 user nova-compute[73052]:       <entry name="uuid">7e88d68a-33cf-467a-9e55-8162648a2b02</entry>
Aug 26 14:49:29 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:49:29 user nova-compute[73052]:     </system>
Aug 26 14:49:29 user nova-compute[73052]:   </sysinfo>
Aug 26 14:49:29 user nova-compute[73052]:   <os>
Aug 26 14:49:29 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:49:29 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:49:29 user nova-compute[73052]:   </os>
Aug 26 14:49:29 user nova-compute[73052]:   <features>
Aug 26 14:49:29 user nova-compute[73052]:     <acpi/>
Aug 26 14:49:29 user nova-compute[73052]:     <apic/>
Aug 26 14:49:29 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:49:29 user nova-compute[73052]:   </features>
Aug 26 14:49:29 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:49:29 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:49:29 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:49:29 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:49:29 user nova-compute[73052]:   </clock>
Aug 26 14:49:29 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:49:29 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:49:29 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:49:29 user nova-compute[73052]:   </cpu>
Aug 26 14:49:29 user nova-compute[73052]:   <devices>
Aug 26 14:49:29 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:49:29 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:49:29 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk"/>
Aug 26 14:49:29 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:49:29 user nova-compute[73052]:     </disk>
Aug 26 14:49:29 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:49:29 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:49:29 user nova-compute[73052]:       <source dev="/dev/sdc"/>
Aug 26 14:49:29 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:49:29 user nova-compute[73052]:       <serial>1657e423-afb0-40aa-b1eb-9ce6ff3148ad</serial>
Aug 26 14:49:29 user nova-compute[73052]:     </disk>
Aug 26 14:49:29 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:49:29 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:49:29 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue"/>
Aug 26 14:49:29 user nova-compute[73052]:       <target dev="vdc" bus="virtio"/>
Aug 26 14:49:29 user nova-compute[73052]:       <boot order="1"/>
Aug 26 14:49:29 user nova-compute[73052]:     </disk>
Aug 26 14:49:29 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:49:29 user nova-compute[73052]:       <mac address="fa:16:3e:c1:d7:cd"/>
Aug 26 14:49:29 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:49:29 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:49:29 user nova-compute[73052]:       <target dev="tapd5c81e0c-e3"/>
Aug 26 14:49:29 user nova-compute[73052]:     </interface>
Aug 26 14:49:29 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:49:29 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/console.log" append="off"/>
Aug 26 14:49:29 user nova-compute[73052]:     </serial>
Aug 26 14:49:29 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:49:29 user nova-compute[73052]:     <video>
Aug 26 14:49:29 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:49:29 user nova-compute[73052]:     </video>
Aug 26 14:49:29 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:49:29 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:49:29 user nova-compute[73052]:     </rng>
Aug 26 14:49:29 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:49:29 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:49:29 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:49:29 user nova-compute[73052]:     </memballoon>
Aug 26 14:49:29 user nova-compute[73052]:   </devices>
Aug 26 14:49:29 user nova-compute[73052]: </domain>
Aug 26 14:49:29 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:49:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance destroyed successfully.
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] No VIF found with MAC fa:16:3e:c1:d7:cd, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:49:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:49:30 user nova-compute[73052]: INFO nova.compute.claims [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Claim successful on node user
Aug 26 14:49:30 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:49:31 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:49:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG nova.policy [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5061033588974e7ead6c7abc8a47308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3fc9a170804f0ebfa2dde967e3fec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-74af8b3f-3c7c-412c-87e8-1a6cb7077040 req-d603fb5e-98ea-450c-877f-7e1aeca30dd1 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74af8b3f-3c7c-412c-87e8-1a6cb7077040 req-d603fb5e-98ea-450c-877f-7e1aeca30dd1 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74af8b3f-3c7c-412c-87e8-1a6cb7077040 req-d603fb5e-98ea-450c-877f-7e1aeca30dd1 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74af8b3f-3c7c-412c-87e8-1a6cb7077040 req-d603fb5e-98ea-450c-877f-7e1aeca30dd1 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-74af8b3f-3c7c-412c-87e8-1a6cb7077040 req-d603fb5e-98ea-450c-877f-7e1aeca30dd1 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:31 user nova-compute[73052]: WARNING nova.compute.manager [req-74af8b3f-3c7c-412c-87e8-1a6cb7077040 req-d603fb5e-98ea-450c-877f-7e1aeca30dd1 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state active and task_state rescuing.
Aug 26 14:49:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:49:31 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Creating image(s)
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "/opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "/opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "/opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.237s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.201s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk 1073741824" returned: 0 in 0.126s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.217s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Successfully created port: 008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Cannot resize image /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Ensure instance console log exists: /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-18c590b3-8732-4bb3-94c8-ec82cd82f97e req-ba2f6459-4a5d-443c-bd81-3b7e1fd99c1a service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18c590b3-8732-4bb3-94c8-ec82cd82f97e req-ba2f6459-4a5d-443c-bd81-3b7e1fd99c1a service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18c590b3-8732-4bb3-94c8-ec82cd82f97e req-ba2f6459-4a5d-443c-bd81-3b7e1fd99c1a service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-18c590b3-8732-4bb3-94c8-ec82cd82f97e req-ba2f6459-4a5d-443c-bd81-3b7e1fd99c1a service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-18c590b3-8732-4bb3-94c8-ec82cd82f97e req-ba2f6459-4a5d-443c-bd81-3b7e1fd99c1a service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:33 user nova-compute[73052]: WARNING nova.compute.manager [req-18c590b3-8732-4bb3-94c8-ec82cd82f97e req-ba2f6459-4a5d-443c-bd81-3b7e1fd99c1a service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state active and task_state rescuing.
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Successfully updated port: 008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for 7e88d68a-33cf-467a-9e55-8162648a2b02 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061373.3612723, 7e88d68a-33cf-467a-9e55-8162648a2b02 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:49:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] VM Resumed (Lifecycle Event)
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-024be574-79b4-4f0a-b667-e365cbd7ee2e tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquired lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-02869f96-dbac-4e00-acc5-92eb2e6e82c9 req-5a8db855-7f11-44e0-b5c2-0883c4dc8c63 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-changed-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-02869f96-dbac-4e00-acc5-92eb2e6e82c9 req-5a8db855-7f11-44e0-b5c2-0883c4dc8c63 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Refreshing instance network info cache due to event network-changed-008d9525-e93d-40f5-ac18-aa9696c0fd7a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-02869f96-dbac-4e00-acc5-92eb2e6e82c9 req-5a8db855-7f11-44e0-b5c2-0883c4dc8c63 service nova] Acquiring lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:49:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061373.3615685, 7e88d68a-33cf-467a-9e55-8162648a2b02 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:49:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] VM Started (Lifecycle Event)
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Releasing lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Instance network_info: |[{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-02869f96-dbac-4e00-acc5-92eb2e6e82c9 req-5a8db855-7f11-44e0-b5c2-0883c4dc8c63 service nova] Acquired lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.neutron [req-02869f96-dbac-4e00-acc5-92eb2e6e82c9 req-5a8db855-7f11-44e0-b5c2-0883c4dc8c63 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Refreshing network info cache for port 008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Start _get_guest_xml network_info=[{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:33 user nova-compute[73052]: INFO nova.compute.manager [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Terminating instance
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:49:33 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:49:33 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1580223323',display_name='tempest-ServerActionsTestOtherA-server-1580223323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1580223323',id=24,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-q1kmm4wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=33ec579e-3ce9-46e3-9e06-ca91fb20571f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=008d9525-e93d-40f5-ac18-aa9696c0fd7a,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008d9525-e9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'pci_devices' on Instance uuid 33ec579e-3ce9-46e3-9e06-ca91fb20571f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:49:33 user nova-compute[73052]:   <uuid>33ec579e-3ce9-46e3-9e06-ca91fb20571f</uuid>
Aug 26 14:49:33 user nova-compute[73052]:   <name>instance-00000018</name>
Aug 26 14:49:33 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:49:33 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:49:33 user nova-compute[73052]:   <metadata>
Aug 26 14:49:33 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:49:33 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:49:33 user nova-compute[73052]:       <nova:name>tempest-ServerActionsTestOtherA-server-1580223323</nova:name>
Aug 26 14:49:33 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:49:33</nova:creationTime>
Aug 26 14:49:33 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:49:33 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:49:33 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:49:33 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:49:33 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:49:33 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:49:33 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:49:33 user nova-compute[73052]:       <nova:owner>
Aug 26 14:49:33 user nova-compute[73052]:         <nova:user uuid="5061033588974e7ead6c7abc8a47308e">tempest-ServerActionsTestOtherA-1682869035-project-member</nova:user>
Aug 26 14:49:33 user nova-compute[73052]:         <nova:project uuid="eb3fc9a170804f0ebfa2dde967e3fec2">tempest-ServerActionsTestOtherA-1682869035</nova:project>
Aug 26 14:49:33 user nova-compute[73052]:       </nova:owner>
Aug 26 14:49:33 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:49:33 user nova-compute[73052]:       <nova:ports>
Aug 26 14:49:33 user nova-compute[73052]:         <nova:port uuid="008d9525-e93d-40f5-ac18-aa9696c0fd7a">
Aug 26 14:49:33 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 14:49:33 user nova-compute[73052]:         </nova:port>
Aug 26 14:49:33 user nova-compute[73052]:       </nova:ports>
Aug 26 14:49:33 user nova-compute[73052]:     </nova:instance>
Aug 26 14:49:33 user nova-compute[73052]:   </metadata>
Aug 26 14:49:33 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:49:33 user nova-compute[73052]:     <system>
Aug 26 14:49:33 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:49:33 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:49:33 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:49:33 user nova-compute[73052]:       <entry name="serial">33ec579e-3ce9-46e3-9e06-ca91fb20571f</entry>
Aug 26 14:49:33 user nova-compute[73052]:       <entry name="uuid">33ec579e-3ce9-46e3-9e06-ca91fb20571f</entry>
Aug 26 14:49:33 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:49:33 user nova-compute[73052]:     </system>
Aug 26 14:49:33 user nova-compute[73052]:   </sysinfo>
Aug 26 14:49:33 user nova-compute[73052]:   <os>
Aug 26 14:49:33 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:49:33 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:49:33 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:49:33 user nova-compute[73052]:   </os>
Aug 26 14:49:33 user nova-compute[73052]:   <features>
Aug 26 14:49:33 user nova-compute[73052]:     <acpi/>
Aug 26 14:49:33 user nova-compute[73052]:     <apic/>
Aug 26 14:49:33 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:49:33 user nova-compute[73052]:   </features>
Aug 26 14:49:33 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:49:33 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:49:33 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:49:33 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:49:33 user nova-compute[73052]:   </clock>
Aug 26 14:49:33 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:49:33 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:49:33 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:49:33 user nova-compute[73052]:   </cpu>
Aug 26 14:49:33 user nova-compute[73052]:   <devices>
Aug 26 14:49:33 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:49:33 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:49:33 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk"/>
Aug 26 14:49:33 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:49:33 user nova-compute[73052]:     </disk>
Aug 26 14:49:33 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:49:33 user nova-compute[73052]:       <mac address="fa:16:3e:7d:8d:33"/>
Aug 26 14:49:33 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:49:33 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:49:33 user nova-compute[73052]:       <target dev="tap008d9525-e9"/>
Aug 26 14:49:33 user nova-compute[73052]:     </interface>
Aug 26 14:49:33 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:49:33 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/console.log" append="off"/>
Aug 26 14:49:33 user nova-compute[73052]:     </serial>
Aug 26 14:49:33 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:49:33 user nova-compute[73052]:     <video>
Aug 26 14:49:33 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:49:33 user nova-compute[73052]:     </video>
Aug 26 14:49:33 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:49:33 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:49:33 user nova-compute[73052]:     </rng>
Aug 26 14:49:33 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:49:33 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:49:33 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:49:33 user nova-compute[73052]:     </memballoon>
Aug 26 14:49:33 user nova-compute[73052]:   </devices>
Aug 26 14:49:33 user nova-compute[73052]: </domain>
Aug 26 14:49:33 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1580223323',display_name='tempest-ServerActionsTestOtherA-server-1580223323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1580223323',id=24,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-q1kmm4wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=33ec579e-3ce9-46e3-9e06-ca91fb20571f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=008d9525-e93d-40f5-ac18-aa9696c0fd7a,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008d9525-e9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG os_vif [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=008d9525-e93d-40f5-ac18-aa9696c0fd7a,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008d9525-e9') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap008d9525-e9, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap008d9525-e9, col_values=(('external_ids', {'iface-id': '008d9525-e93d-40f5-ac18-aa9696c0fd7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:8d:33', 'vm-uuid': '33ec579e-3ce9-46e3-9e06-ca91fb20571f'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:33 user nova-compute[73052]: INFO os_vif [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=008d9525-e93d-40f5-ac18-aa9696c0fd7a,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008d9525-e9')
Aug 26 14:49:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:49:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No VIF found with MAC fa:16:3e:7d:8d:33, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:49:34 user nova-compute[73052]: DEBUG nova.network.neutron [req-02869f96-dbac-4e00-acc5-92eb2e6e82c9 req-5a8db855-7f11-44e0-b5c2-0883c4dc8c63 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updated VIF entry in instance network info cache for port 008d9525-e93d-40f5-ac18-aa9696c0fd7a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:49:34 user nova-compute[73052]: DEBUG nova.network.neutron [req-02869f96-dbac-4e00-acc5-92eb2e6e82c9 req-5a8db855-7f11-44e0-b5c2-0883c4dc8c63 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:49:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-02869f96-dbac-4e00-acc5-92eb2e6e82c9 req-5a8db855-7f11-44e0-b5c2-0883c4dc8c63 service nova] Releasing lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:49:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Instance destroyed successfully.
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lazy-loading 'resources' on Instance uuid 86d43ddf-d653-4771-9d24-4c3617664337 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210334405',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210334405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210334',id=19,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBePImJQg9NCHRdLAXMk/RG38TYcpDmBnd/XudtRWf2OYdo7CFwUeSCXuEn88u3APtJlNat95ek2VM5aoELDYSXCFxrzb4i3MN+GOEQGo2qEdSrCJkjB83Yr2VQ+ffJ10g==',key_name='tempest-keypair-1368672479',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='253c7bd7757f4c61a805538705b34087',ramdisk_id='',reservation_id='r-xtk9k44l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1368852551',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa8d9ab665654f509c2a46d880620092',uuid=86d43ddf-d653-4771-9d24-4c3617664337,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Converting VIF {"id": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "address": "fa:16:3e:ee:8c:65", "network": {"id": "5565c90f-5516-4a2e-afdd-0b56f58ae38c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2123515351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253c7bd7757f4c61a805538705b34087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9280eae-40", "ovs_interfaceid": "e9280eae-40b0-4dbb-b31a-7499008b1cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:8c:65,bridge_name='br-int',has_traffic_filtering=True,id=e9280eae-40b0-4dbb-b31a-7499008b1cf9,network=Network(5565c90f-5516-4a2e-afdd-0b56f58ae38c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9280eae-40') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG os_vif [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:8c:65,bridge_name='br-int',has_traffic_filtering=True,id=e9280eae-40b0-4dbb-b31a-7499008b1cf9,network=Network(5565c90f-5516-4a2e-afdd-0b56f58ae38c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9280eae-40') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9280eae-40, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:35 user nova-compute[73052]: INFO os_vif [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:8c:65,bridge_name='br-int',has_traffic_filtering=True,id=e9280eae-40b0-4dbb-b31a-7499008b1cf9,network=Network(5565c90f-5516-4a2e-afdd-0b56f58ae38c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9280eae-40')
Aug 26 14:49:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Deleting instance files /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337_del
Aug 26 14:49:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Deletion of /opt/stack/data/nova/instances/86d43ddf-d653-4771-9d24-4c3617664337_del complete
Aug 26 14:49:35 user nova-compute[73052]: INFO nova.compute.manager [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Took 1.52 seconds to destroy the instance on the hypervisor.
Aug 26 14:49:35 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received event network-vif-unplugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] No waiting events found dispatching network-vif-unplugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received event network-vif-unplugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received event network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] Acquiring lock "86d43ddf-d653-4771-9d24-4c3617664337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] Lock "86d43ddf-d653-4771-9d24-4c3617664337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] No waiting events found dispatching network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:35 user nova-compute[73052]: WARNING nova.compute.manager [req-bb18163c-27c7-4e70-b12f-91d14c5ec528 req-e65a5327-c6fb-4a11-8cff-593b0ac64db9 service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received unexpected event network-vif-plugged-e9280eae-40b0-4dbb-b31a-7499008b1cf9 for instance with vm_state active and task_state deleting.
Aug 26 14:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-c5161799-e48a-451b-b05f-79a4a538889e req-e5ed8c1a-c96b-4201-baed-f948e273f0c5 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c5161799-e48a-451b-b05f-79a4a538889e req-e5ed8c1a-c96b-4201-baed-f948e273f0c5 service nova] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c5161799-e48a-451b-b05f-79a4a538889e req-e5ed8c1a-c96b-4201-baed-f948e273f0c5 service nova] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c5161799-e48a-451b-b05f-79a4a538889e req-e5ed8c1a-c96b-4201-baed-f948e273f0c5 service nova] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-c5161799-e48a-451b-b05f-79a4a538889e req-e5ed8c1a-c96b-4201-baed-f948e273f0c5 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] No waiting events found dispatching network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:36 user nova-compute[73052]: WARNING nova.compute.manager [req-c5161799-e48a-451b-b05f-79a4a538889e req-e5ed8c1a-c96b-4201-baed-f948e273f0c5 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received unexpected event network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a for instance with vm_state building and task_state spawning.
Aug 26 14:49:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:49:36 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Took 1.47 seconds to deallocate network for instance.
Aug 26 14:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:37 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:49:37 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:49:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:37 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Deleted allocations for instance 86d43ddf-d653-4771-9d24-4c3617664337
Aug 26 14:49:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f811347b-1e08-48d7-94b7-656d4a526061 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551 tempest-TestServerVolumeAttachScenarioOldVersion-1368852551-project-member] Lock "86d43ddf-d653-4771-9d24-4c3617664337" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.816s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061378.4274814, 33ec579e-3ce9-46e3-9e06-ca91fb20571f => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:49:38 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] VM Resumed (Lifecycle Event)
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:49:38 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Instance spawned successfully.
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:49:38 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061378.4319806, 33ec579e-3ce9-46e3-9e06-ca91fb20571f => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:49:38 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] VM Started (Lifecycle Event)
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:49:38 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:49:38 user nova-compute[73052]: INFO nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Took 7.23 seconds to spawn the instance on the hypervisor.
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:38 user nova-compute[73052]: INFO nova.compute.manager [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Took 8.34 seconds to build instance.
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-3c4a48e4-ccaa-4d2c-b427-6023b54cd2eb req-ca81156a-fa69-4b62-ba46-6c5c5440d77b service nova] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Received event network-vif-deleted-e9280eae-40b0-4dbb-b31a-7499008b1cf9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-3c4a48e4-ccaa-4d2c-b427-6023b54cd2eb req-ca81156a-fa69-4b62-ba46-6c5c5440d77b service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3c4a48e4-ccaa-4d2c-b427-6023b54cd2eb req-ca81156a-fa69-4b62-ba46-6c5c5440d77b service nova] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3c4a48e4-ccaa-4d2c-b427-6023b54cd2eb req-ca81156a-fa69-4b62-ba46-6c5c5440d77b service nova] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3c4a48e4-ccaa-4d2c-b427-6023b54cd2eb req-ca81156a-fa69-4b62-ba46-6c5c5440d77b service nova] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-3c4a48e4-ccaa-4d2c-b427-6023b54cd2eb req-ca81156a-fa69-4b62-ba46-6c5c5440d77b service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] No waiting events found dispatching network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:38 user nova-compute[73052]: WARNING nova.compute.manager [req-3c4a48e4-ccaa-4d2c-b427-6023b54cd2eb req-ca81156a-fa69-4b62-ba46-6c5c5440d77b service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received unexpected event network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a for instance with vm_state active and task_state None.
Aug 26 14:49:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e82c2d19-501a-42eb-8268-9d30daa32c66 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.470s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:39 user nova-compute[73052]: INFO nova.compute.manager [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Shelving
Aug 26 14:49:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba2fe4ae-6eef-4aa4-bcac-b92360fd6e0c req-425da805-e213-4fda-bce3-94a2862b7351 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-unplugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba2fe4ae-6eef-4aa4-bcac-b92360fd6e0c req-425da805-e213-4fda-bce3-94a2862b7351 service nova] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba2fe4ae-6eef-4aa4-bcac-b92360fd6e0c req-425da805-e213-4fda-bce3-94a2862b7351 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ba2fe4ae-6eef-4aa4-bcac-b92360fd6e0c req-425da805-e213-4fda-bce3-94a2862b7351 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-ba2fe4ae-6eef-4aa4-bcac-b92360fd6e0c req-425da805-e213-4fda-bce3-94a2862b7351 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] No waiting events found dispatching network-vif-unplugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:39 user nova-compute[73052]: WARNING nova.compute.manager [req-ba2fe4ae-6eef-4aa4-bcac-b92360fd6e0c req-425da805-e213-4fda-bce3-94a2862b7351 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received unexpected event network-vif-unplugged-25613dee-a11d-49c8-aeba-808b01197e7a for instance with vm_state active and task_state shelving.
Aug 26 14:49:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance destroyed successfully.
Aug 26 14:49:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Beginning cold snapshot process
Aug 26 14:49:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:40 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:49:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk /opt/stack/data/nova/instances/snapshots/tmpzwyfv8gf/cb00ffc208804d17bd7466429343cd6b {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk /opt/stack/data/nova/instances/snapshots/tmpzwyfv8gf/cb00ffc208804d17bd7466429343cd6b" returned: 0 in 0.789s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Snapshot extracted, beginning image upload
Aug 26 14:49:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-a42d574a-9a4f-4a57-821a-a2c8428e7706 req-4180bb45-eb67-41e5-a295-37f997f92664 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a42d574a-9a4f-4a57-821a-a2c8428e7706 req-4180bb45-eb67-41e5-a295-37f997f92664 service nova] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a42d574a-9a4f-4a57-821a-a2c8428e7706 req-4180bb45-eb67-41e5-a295-37f997f92664 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a42d574a-9a4f-4a57-821a-a2c8428e7706 req-4180bb45-eb67-41e5-a295-37f997f92664 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-a42d574a-9a4f-4a57-821a-a2c8428e7706 req-4180bb45-eb67-41e5-a295-37f997f92664 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] No waiting events found dispatching network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:49:41 user nova-compute[73052]: WARNING nova.compute.manager [req-a42d574a-9a4f-4a57-821a-a2c8428e7706 req-4180bb45-eb67-41e5-a295-37f997f92664 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received unexpected event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 14:49:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Snapshot image upload complete
Aug 26 14:49:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:43 user nova-compute[73052]: INFO nova.compute.manager [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Shelve offloading
Aug 26 14:49:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance destroyed successfully.
Aug 26 14:49:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:49:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquired lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:49:43 user nova-compute[73052]: DEBUG nova.network.neutron [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:49:44 user nova-compute[73052]: DEBUG nova.network.neutron [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating instance_info_cache with network_info: [{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:49:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Releasing lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:49:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance destroyed successfully.
Aug 26 14:49:44 user nova-compute[73052]: DEBUG nova.objects.instance [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'resources' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-974097995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-974097995',id=20,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxkGTZIwhwifi3AWxYsd1u+oJMT8+InAe7LUzawcAt5ZVVe6ftgimyrZAKb0Dc7pG5Q2DKzybFjs3hwqYCtXQJiZGbrheLePJ6Q6iK9gnk0vPOJbjPbxoF3B7JweqYXbQ==',key_name='tempest-keypair-746986181',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-bawqgpzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member',shelved_at='2023-08-26T14:49:43.693496',shelved_host='user',shelved_image_id='76cdd8ad-f337-4569-bfbc-1e8d9e2f980c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=83e00d7a-c0a0-4e39-af7c-c2fb9a564406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG os_vif [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25613dee-a1, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:49:45 user nova-compute[73052]: INFO os_vif [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1')
Aug 26 14:49:45 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Deleting instance files /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406_del
Aug 26 14:49:45 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Deletion of /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406_del complete
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-bad2a9aa-3bac-444c-9f4a-c35c3b5edf68 req-86fa909b-7f79-409d-a418-e29c061f8a0b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-changed-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-bad2a9aa-3bac-444c-9f4a-c35c3b5edf68 req-86fa909b-7f79-409d-a418-e29c061f8a0b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Refreshing instance network info cache due to event network-changed-25613dee-a11d-49c8-aeba-808b01197e7a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bad2a9aa-3bac-444c-9f4a-c35c3b5edf68 req-86fa909b-7f79-409d-a418-e29c061f8a0b service nova] Acquiring lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bad2a9aa-3bac-444c-9f4a-c35c3b5edf68 req-86fa909b-7f79-409d-a418-e29c061f8a0b service nova] Acquired lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.network.neutron [req-bad2a9aa-3bac-444c-9f4a-c35c3b5edf68 req-86fa909b-7f79-409d-a418-e29c061f8a0b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Refreshing network info cache for port 25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:49:45 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Deleted allocations for instance 83e00d7a-c0a0-4e39-af7c-c2fb9a564406
Aug 26 14:49:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'numa_topology' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.objects.base [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<83e00d7a-c0a0-4e39-af7c-c2fb9a564406> lazy-loaded attributes: resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.network.neutron [req-bad2a9aa-3bac-444c-9f4a-c35c3b5edf68 req-86fa909b-7f79-409d-a418-e29c061f8a0b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updated VIF entry in instance network info cache for port 25613dee-a11d-49c8-aeba-808b01197e7a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG nova.network.neutron [req-bad2a9aa-3bac-444c-9f4a-c35c3b5edf68 req-86fa909b-7f79-409d-a418-e29c061f8a0b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating instance_info_cache with network_info: [{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap25613dee-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bad2a9aa-3bac-444c-9f4a-c35c3b5edf68 req-86fa909b-7f79-409d-a418-e29c061f8a0b service nova] Releasing lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:49:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-100bc473-0100-4ad2-a611-6b984b42a12f tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.444s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lazy-loading 'flavor' on Instance uuid 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061375.163458, 86d43ddf-d653-4771-9d24-4c3617664337 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:49:50 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] VM Stopped (Lifecycle Event)
Aug 26 14:49:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0d6c0e90-1c19-44af-91ad-016e68c6feb2 None None] [instance: 86d43ddf-d653-4771-9d24-4c3617664337] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:49:50 user nova-compute[73052]: INFO nova.compute.manager [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Attaching volume 5fe931b3-9a09-4e00-b36d-bbcf1b77e280 to /dev/vdb
Aug 26 14:49:50 user nova-compute[73052]: DEBUG os_brick.utils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6cc40b-ab87-42e5-a742-87f1585cf14c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc9a88d-e970-4024-bb39-2dcfb9494d2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c14a37-d347-49f6-99ce-d822f8e86b34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3001f0-aeb2-4c1d-b850-4b9db501f1eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:49:50 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:49:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7079a1-346a-401a-85c0-b4819c323ae9]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG os_brick.utils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:49:50 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating existing volume attachment record: 4210901a-2548-4cb2-9bc7-deabc1e3f9ac {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:49:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:54 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061379.9492633, 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:49:54 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] VM Stopped (Lifecycle Event)
Aug 26 14:49:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-273c12e7-2dfc-4394-9292-0f9d5dad8891 None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:49:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:49:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:50:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:02 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:02 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:02 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f559906-06af-498e-98b4-fabebc21971a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:50:02 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[580fb79c-ec2f-45c0-86a4-86cd06df980a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280] added
Aug 26 14:50:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f369898b-0cff-4b5e-b39e-c96f0bec622a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ff6407-2b04-45b5-b24c-58793da2899b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfzBVdZX {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfzBVdZX" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea05357-f350-49ee-bcb1-0e0349015ff5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfzBVdZX'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0565b0-501d-4865-9193-2240f90338b8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba222396-7356-4fc6-bdbe-9b8073074987]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c552f993-cddb-479a-9503-c2cfda9b72e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]
Aug 26 14:50:02 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1ed31-cf22-4c1a-97c7-817fc21a542a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f37789-1cfe-4a19-9162-c2d293675be2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:02 user nova-compute[73052]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[681180d7-1026-40da-8a9c-a05e18c14586]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:50:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:50:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23636366661643963', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636366661643963', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:50:03 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lazy-loading 'flavor' on Instance uuid 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:50:03 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:03 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:50:03 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:50:03 user nova-compute[73052]:   <serial>5fe931b3-9a09-4e00-b36d-bbcf1b77e280</serial>
Aug 26 14:50:03 user nova-compute[73052]: </disk>
Aug 26 14:50:03 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] No VIF found with MAC fa:16:3e:5d:9d:ed, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:04 user nova-compute[73052]: INFO nova.compute.manager [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attaching volume a1d787ea-0fa0-403f-8e0e-110294892d8f to /dev/vdb
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG os_brick.utils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ad58466a-7b22-46ef-a036-1a0375adec86 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.679s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc1c53-e6bb-4e25-b87f-1e7591277fe5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5035c141-ce4e-44d0-bbeb-b2c3aa55a4de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7dc196-9215-4b39-99a3-88b0454e81d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[752ad0a0-0a5f-4217-bdc6-88f437038a0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:50:05 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5322ac-ee8f-4be0-8c07-6c3a56e8170c]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG os_brick.utils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating existing volume attachment record: e17a01a8-8d67-4524-acaa-5a5a49dc1271 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:06 user nova-compute[73052]: INFO nova.compute.manager [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Terminating instance
Aug 26 14:50:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-a01f5bcc-a336-41bc-8e5b-73bab36217d3 req-14dc5865-08b0-401a-9525-ec6b0ee5c7e0 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received event network-vif-unplugged-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a01f5bcc-a336-41bc-8e5b-73bab36217d3 req-14dc5865-08b0-401a-9525-ec6b0ee5c7e0 service nova] Acquiring lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a01f5bcc-a336-41bc-8e5b-73bab36217d3 req-14dc5865-08b0-401a-9525-ec6b0ee5c7e0 service nova] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a01f5bcc-a336-41bc-8e5b-73bab36217d3 req-14dc5865-08b0-401a-9525-ec6b0ee5c7e0 service nova] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-a01f5bcc-a336-41bc-8e5b-73bab36217d3 req-14dc5865-08b0-401a-9525-ec6b0ee5c7e0 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] No waiting events found dispatching network-vif-unplugged-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-a01f5bcc-a336-41bc-8e5b-73bab36217d3 req-14dc5865-08b0-401a-9525-ec6b0ee5c7e0 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received event network-vif-unplugged-226ca57a-f424-4dd5-ad46-1acac336f402 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Stashing vm_state: active {{(pid=73052) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.013s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:50:07 user nova-compute[73052]: INFO nova.compute.claims [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Claim successful on node user
Aug 26 14:50:07 user nova-compute[73052]: INFO nova.compute.resource_tracker [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating resource usage from migration d2fd62e9-9918-4984-94f2-3806d39e796d
Aug 26 14:50:07 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Instance destroyed successfully.
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'resources' on Instance uuid e036233c-9812-4f01-a74b-bdfd6ca23b4f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-736480186',display_name='tempest-TestVolumeBootPattern-server-736480186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-736480186',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-64ebmw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:48:40Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=e036233c-9812-4f01-a74b-bdfd6ca23b4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "226ca57a-f424-4dd5-ad46-1acac336f402", "address": "fa:16:3e:c5:c2:46", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ca57a-f4", "ovs_interfaceid": "226ca57a-f424-4dd5-ad46-1acac336f402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c2:46,bridge_name='br-int',has_traffic_filtering=True,id=226ca57a-f424-4dd5-ad46-1acac336f402,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ca57a-f4') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG os_vif [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c2:46,bridge_name='br-int',has_traffic_filtering=True,id=226ca57a-f424-4dd5-ad46-1acac336f402,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ca57a-f4') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap226ca57a-f4, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:50:07 user nova-compute[73052]: INFO os_vif [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c2:46,bridge_name='br-int',has_traffic_filtering=True,id=226ca57a-f424-4dd5-ad46-1acac336f402,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ca57a-f4')
Aug 26 14:50:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgeDqwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:07 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:07 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:07 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.objects.instance [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lazy-loading 'flavor' on Instance uuid 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91a5c0e-4758-44cf-b22d-736667710c3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabc98cb-b24a-4cf9-99d8-7a96f5f049b2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:50:08 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:08 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:08 user nova-compute[73052]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:08 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed (non-flash)
Aug 26 14:50:08 user nova-compute[73052]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:08 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:08 user nova-compute[73052]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:08 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c750af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[81caaf31-be32-4341-b096-0bbfa909f4c5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45defa8-e3e2-40fa-b57d-2bd8985f4919]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff7291-cf0a-464d-a374-287d83e4cfca]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914d886-13d2-4baf-b573-53798d906b19]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d4a7f3-dd8f-439e-8e9f-bb0706f3a225]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:08 user nova-compute[73052]: INFO nova.compute.manager [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Attaching volume 210eaf10-bf68-4522-b513-913164ea55c6 to /dev/vdb
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.utils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5280a3-4d75-4792-ae4f-0c1510d84c8a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed, portal: 172.16.0.220,3260]
Aug 26 14:50:08 user nova-compute[73052]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:08 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fd366c-f145-407e-b9b4-aff31b698a8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5516c6bf-4e19-47c8-a7ee-2f22407871ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f991262d-3ffc-4636-b84d-3b363aca7794]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab4b176-62a2-4c6f-ac30-1a51ed4fee2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== disconnect_volume: return (451ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:50:08 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Deleting instance files /opt/stack/data/nova/instances/e036233c-9812-4f01-a74b-bdfd6ca23b4f_del
Aug 26 14:50:08 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Deletion of /opt/stack/data/nova/instances/e036233c-9812-4f01-a74b-bdfd6ca23b4f_del complete
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f40b40b-3f17-4f5a-a482-fc812bb36afe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aa8134-3a22-432d-9e72-1cbaa1baf9ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.898s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:08 user nova-compute[73052]: INFO nova.compute.manager [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Migrating
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: INFO nova.compute.rpcapi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:50:08 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[595e53c9-1de7-4002-858c-633d2726ffc4]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG os_brick.utils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Updating existing volume attachment record: f108aac2-5a11-41e9-9961-4a7b2e0a7266 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:08 user nova-compute[73052]: INFO nova.compute.manager [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Took 1.64 seconds to destroy the instance on the hypervisor.
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquired lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:09 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Took 0.56 seconds to deallocate network for instance.
Aug 26 14:50:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-e3a7965d-ed30-4007-b63e-c3adb454581e req-2dfb6993-0be5-43fe-992a-645d6b3fd24d service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received event network-vif-deleted-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Releasing lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-6ce34cfd-17b7-4367-8fae-a279df8fb11f req-8ba03b81-a220-4253-baee-8b2a9974dae3 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received event network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6ce34cfd-17b7-4367-8fae-a279df8fb11f req-8ba03b81-a220-4253-baee-8b2a9974dae3 service nova] Acquiring lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6ce34cfd-17b7-4367-8fae-a279df8fb11f req-8ba03b81-a220-4253-baee-8b2a9974dae3 service nova] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6ce34cfd-17b7-4367-8fae-a279df8fb11f req-8ba03b81-a220-4253-baee-8b2a9974dae3 service nova] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-6ce34cfd-17b7-4367-8fae-a279df8fb11f req-8ba03b81-a220-4253-baee-8b2a9974dae3 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] No waiting events found dispatching network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:09 user nova-compute[73052]: WARNING nova.compute.manager [req-6ce34cfd-17b7-4367-8fae-a279df8fb11f req-8ba03b81-a220-4253-baee-8b2a9974dae3 service nova] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Received unexpected event network-vif-plugged-226ca57a-f424-4dd5-ad46-1acac336f402 for instance with vm_state active and task_state deleting.
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Starting migrate_disk_and_power_off {{(pid=73052) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:50:09 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid 'e036233c-9812-4f01-a74b-bdfd6ca23b4f' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e036233c-9812-4f01-a74b-bdfd6ca23b4f' (instance-00000016)
Aug 26 14:50:10 user nova-compute[73052]: INFO nova.compute.manager [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Took 1.50 seconds to detach 1 volumes for instance.
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Deleting volume: 5516c6bf-4e19-47c8-a7ee-2f22407871ed {{(pid=73052) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 14:50:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance destroyed successfully.
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1401820556-network", "vif_mac": "fa:16:3e:5d:9d:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1401820556-network", "vif_mac": "fa:16:3e:5d:9d:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_vif [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:50:10 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:50:10 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7028MB free_disk=25.15011978149414GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd15d9bd-b8, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:10 user nova-compute[73052]: INFO os_vif [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8')
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:10 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c77d14f-8428-4e0b-aa01-a1ee953ee08b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0277a9-d38e-436e-a30e-459a9e08ff93]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:10 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:10 user nova-compute[73052]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:10 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:10 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:10 user nova-compute[73052]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:10 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7f17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[651de3d1-6478-4108-9ff6-82388b1bb060]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Applying migration context for instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 as it has an incoming, in-progress migration d2fd62e9-9918-4984-94f2-3806d39e796d. Migration status is migrating {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 14:50:10 user nova-compute[73052]: INFO nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating resource usage from migration d2fd62e9-9918-4984-94f2-3806d39e796d
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[436a7108-deb3-4391-b259-b9e2ccdc221d]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7e88d68a-33cf-467a-9e55-8162648a2b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c35499ba-06cb-443c-b019-5d3f9ea4c04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e036233c-9812-4f01-a74b-bdfd6ca23b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Migration d2fd62e9-9918-4984-94f2-3806d39e796d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[da768ba1-703c-443f-bf37-da695c6f93f6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75355a5-d4f7-40a2-a4ff-7ec7aa2cc455]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:50:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.048s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac215f-235c-4b1e-baa1-d1925751eb37]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[658488ac-23c9-4fa2-910e-15542016fcc8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]
Aug 26 14:50:11 user nova-compute[73052]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:11 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b8656-4ae6-4366-a856-30a85ec8296d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== disconnect_volume: return (360ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.583s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:11 user nova-compute[73052]: WARNING nova.compute.manager [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state active and task_state resize_migrating.
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:11 user nova-compute[73052]: WARNING nova.compute.manager [req-2243df03-c8e0-44c6-98cf-c423ab267e38 req-134d96a4-9d47-4a45-ae56-51003a209064 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state active and task_state resize_migrating.
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6_resize/disk /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:11 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Deleted allocations for instance e036233c-9812-4f01-a74b-bdfd6ca23b4f
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "cp -r /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6_resize/disk /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk" returned: 0 in 0.423s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6_resize/disk.info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk.info {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "cp -r /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6_resize/disk.info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk.info" returned: 0 in 0.035s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c376d0ed-90ee-404f-9299-ca4903e5771a tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "e036233c-9812-4f01-a74b-bdfd6ca23b4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.085s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Port fd15d9bd-b847-4224-8279-fa3bbb3958b9 binding to destination host user is already ACTIVE {{(pid=73052) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquired lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Releasing lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG os_brick.utils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1873f768-7a24-4095-8b76-940caf8ed69c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29bb097-8ad5-444d-ad25-2cf1a8a04048]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ec737c-ab13-46d6-be07-54fcfc1d1d9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cac4f3e-9df8-4ee5-8102-e8588920d69c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:50:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:50:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:50:14 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:50:14 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecb09c2-5ffb-49ba-8f60-55a7731aeb41]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:50:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:50:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:50:14 user nova-compute[73052]: DEBUG os_brick.utils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vetbzCfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:17 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:17 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:17 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9558f4c3-fab6-4fa9-b6ec-477efe29863e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:50:17 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[374dee49-b448-4822-8eb2-a3ddc78fbc96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f] added
Aug 26 14:50:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0a4393-934f-491c-8f87-f3f1d09e28ab]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d715b-73dc-48b5-8fb0-47140016700f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vetbzCfW {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vetbzCfW" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b4415-104c-47a0-b4a7-62586e8f83e4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vetbzCfW'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb57e7-b2bb-4bc5-b2bf-7131059c9648]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9153f8-29cf-44de-ae4d-f743de608f74]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:18 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:18 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa7415-f842-4bb1-94f8-3da02aa4f8f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f, portal: 172.16.0.220,3260]
Aug 26 14:50:18 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4358695-ece0-40a9-9137-4594805b0f73]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f88103e-b45b-4fcb-8be9-6eaa427f1dd1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:18 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:18 user nova-compute[73052]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f (non-flash)
Aug 26 14:50:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:18 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:18 user nova-compute[73052]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f (non-flash)
Aug 26 14:50:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe813efe-a593-49b9-9c2c-64f4b6a119ef]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vetbzCfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26538393830356463', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538393830356463', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:50:19 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:19 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:50:19 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:50:19 user nova-compute[73052]:   <serial>a1d787ea-0fa0-403f-8e0e-110294892d8f</serial>
Aug 26 14:50:19 user nova-compute[73052]: </disk>
Aug 26 14:50:19 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No VIF found with MAC fa:16:3e:51:e9:f0, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:50:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a68a83b7-0a14-462c-8628-79e54cedc94e tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.127s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:50:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:21 user nova-compute[73052]: INFO nova.compute.manager [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Detaching volume a1d787ea-0fa0-403f-8e0e-110294892d8f
Aug 26 14:50:21 user nova-compute[73052]: INFO nova.virt.block_device [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attempting to driver detach volume a1d787ea-0fa0-403f-8e0e-110294892d8f from mountpoint /dev/vdb
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Attempting to detach device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:50:22 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:22 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:50:22 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:50:22 user nova-compute[73052]:   <serial>a1d787ea-0fa0-403f-8e0e-110294892d8f</serial>
Aug 26 14:50:22 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:50:22 user nova-compute[73052]: </disk>
Aug 26 14:50:22 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:50:22 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully detached device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the persistent domain config.
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:50:22 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:22 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:50:22 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:50:22 user nova-compute[73052]:   <serial>a1d787ea-0fa0-403f-8e0e-110294892d8f</serial>
Aug 26 14:50:22 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:50:22 user nova-compute[73052]: </disk>
Aug 26 14:50:22 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061422.5105186, 92558f0f-dc80-4acf-b3b9-27d0244c0ddb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:50:22 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully detached device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the live domain config.
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vetbzCfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:22 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[95df42ad-ed48-48da-86eb-e6070cbea913]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1807479-17fa-4cea-8478-741d3af1a51c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:22 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:22 user nova-compute[73052]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f (non-flash)
Aug 26 14:50:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:22 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:22 user nova-compute[73052]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f (non-flash)
Aug 26 14:50:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01e6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec846ef-f04d-42da-8a71-8961838fdb9d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a396da5-8701-45ee-90f7-7cb281b7c6a1]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48553a0-9eda-42d4-849f-96b14678945f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[57642746-d621-4533-a3b2-2e4eb28878b7]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0b17aa-9ce8-40a4-ab72-25350b964c5f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cace25-14f3-42f2-ac43-8dc1e89429a2]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f, portal: 172.16.0.220,3260]
Aug 26 14:50:22 user nova-compute[73052]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d787ea-0fa0-403f-8e0e-110294892d8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8287cb9-81c4-41ee-b96d-2ce4ee9d8fba]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== disconnect_volume: return (302ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061407.8668928, e036233c-9812-4f01-a74b-bdfd6ca23b4f => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:50:22 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] VM Stopped (Lifecycle Event)
Aug 26 14:50:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-16a9beaf-37d5-43b9-8c7b-3d88efb9e67f None None] [instance: e036233c-9812-4f01-a74b-bdfd6ca23b4f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:50:23 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7b57831b-6e70-4294-8f3f-2dd310456640 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.876s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:25 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061410.3961813, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:50:25 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Stopped (Lifecycle Event)
Aug 26 14:50:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-65930909-35da-491e-8716-63ccabdd9d76 None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:50:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-65930909-35da-491e-8716-63ccabdd9d76 None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:50:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:25 user nova-compute[73052]: INFO nova.compute.manager [None req-65930909-35da-491e-8716-63ccabdd9d76 None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 14:50:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Starting finish_migration {{(pid=73052) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 14:50:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance directory exists: not creating {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 14:50:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Creating image(s)
Aug 26 14:50:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk. size=21474836480 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk 21474836480 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk 21474836480" returned: 0 in 0.055s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Ensure instance console log exists: /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Start _get_guest_xml network_info=[{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1401820556-network", "vif_mac": "fa:16:3e:5d:9d:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '63ba482c-4a99-490d-9044-9b5eac36c5a6', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6', 'attached_at': '2023-08-26T14:50:27.000000', 'detached_at': '', 'volume_id': '5fe931b3-9a09-4e00-b36d-bbcf1b77e280', 'serial': '5fe931b3-9a09-4e00-b36d-bbcf1b77e280'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:50:27 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:50:27 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:27 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:27 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:27 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f1a045-1bf7-4526-9acf-be579cbe434f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:50:27 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea27493-9a1a-442c-a4aa-1d5b149a91ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280] added
Aug 26 14:50:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d5d071-9c88-4dc4-933b-97c88c338116]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7468b8db-c3c7-4e56-a88d-9fce6016ef10]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfzBVdZX {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfzBVdZX" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b53031b-649f-408c-8e1f-aa6b917a6d95]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfzBVdZX'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b98ed2-e578-4e35-974d-bf6c4d0c9296]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca174f07-9fc9-47f3-b19e-87bc7f8f1fff]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:27 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:27 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e11c7-a37e-41ea-9d71-d5c7628eb0b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]
Aug 26 14:50:27 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea459934-df04-45fc-bb6f-86b51609c582]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e7d4dd-c502-4477-bcc2-8d05e1c00a4f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:27 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:27 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:27 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:27 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b15de8c-3a23-4ba2-84c0-a848ab9c44ce]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:50:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23636366661643963', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636366661643963', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1401820556-network", "vif_mac": "fa:16:3e:5d:9d:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1401820556-network", "vif_mac": "fa:16:3e:5d:9d:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:50:28 user nova-compute[73052]:   <uuid>3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</uuid>
Aug 26 14:50:28 user nova-compute[73052]:   <name>instance-00000011</name>
Aug 26 14:50:28 user nova-compute[73052]:   <memory>2097152</memory>
Aug 26 14:50:28 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:50:28 user nova-compute[73052]:   <metadata>
Aug 26 14:50:28 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:50:28 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:50:28 user nova-compute[73052]:       <nova:name>tempest-ServerActionsTestOtherB-server-900953138</nova:name>
Aug 26 14:50:28 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:50:27</nova:creationTime>
Aug 26 14:50:28 user nova-compute[73052]:       <nova:flavor name="m1.small">
Aug 26 14:50:28 user nova-compute[73052]:         <nova:memory>2048</nova:memory>
Aug 26 14:50:28 user nova-compute[73052]:         <nova:disk>20</nova:disk>
Aug 26 14:50:28 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:50:28 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:50:28 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:50:28 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:50:28 user nova-compute[73052]:       <nova:owner>
Aug 26 14:50:28 user nova-compute[73052]:         <nova:user uuid="bb9db00a77d444f791cccb1be3d9150c">tempest-ServerActionsTestOtherB-135111462-project-member</nova:user>
Aug 26 14:50:28 user nova-compute[73052]:         <nova:project uuid="9dbc99e80f5340d0ab8b4c7fe2d0a0c1">tempest-ServerActionsTestOtherB-135111462</nova:project>
Aug 26 14:50:28 user nova-compute[73052]:       </nova:owner>
Aug 26 14:50:28 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:50:28 user nova-compute[73052]:       <nova:ports>
Aug 26 14:50:28 user nova-compute[73052]:         <nova:port uuid="fd15d9bd-b847-4224-8279-fa3bbb3958b9">
Aug 26 14:50:28 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 14:50:28 user nova-compute[73052]:         </nova:port>
Aug 26 14:50:28 user nova-compute[73052]:       </nova:ports>
Aug 26 14:50:28 user nova-compute[73052]:     </nova:instance>
Aug 26 14:50:28 user nova-compute[73052]:   </metadata>
Aug 26 14:50:28 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:50:28 user nova-compute[73052]:     <system>
Aug 26 14:50:28 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:50:28 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:50:28 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:50:28 user nova-compute[73052]:       <entry name="serial">3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</entry>
Aug 26 14:50:28 user nova-compute[73052]:       <entry name="uuid">3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</entry>
Aug 26 14:50:28 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:50:28 user nova-compute[73052]:     </system>
Aug 26 14:50:28 user nova-compute[73052]:   </sysinfo>
Aug 26 14:50:28 user nova-compute[73052]:   <os>
Aug 26 14:50:28 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:50:28 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:50:28 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:50:28 user nova-compute[73052]:   </os>
Aug 26 14:50:28 user nova-compute[73052]:   <features>
Aug 26 14:50:28 user nova-compute[73052]:     <acpi/>
Aug 26 14:50:28 user nova-compute[73052]:     <apic/>
Aug 26 14:50:28 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:50:28 user nova-compute[73052]:   </features>
Aug 26 14:50:28 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:50:28 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:50:28 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:50:28 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:50:28 user nova-compute[73052]:   </clock>
Aug 26 14:50:28 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:50:28 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:50:28 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:50:28 user nova-compute[73052]:   </cpu>
Aug 26 14:50:28 user nova-compute[73052]:   <devices>
Aug 26 14:50:28 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:50:28 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:50:28 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk"/>
Aug 26 14:50:28 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:50:28 user nova-compute[73052]:     </disk>
Aug 26 14:50:28 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:50:28 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:28 user nova-compute[73052]:       <source dev="/dev/sdd"/>
Aug 26 14:50:28 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:50:28 user nova-compute[73052]:       <serial>5fe931b3-9a09-4e00-b36d-bbcf1b77e280</serial>
Aug 26 14:50:28 user nova-compute[73052]:     </disk>
Aug 26 14:50:28 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:50:28 user nova-compute[73052]:       <mac address="fa:16:3e:5d:9d:ed"/>
Aug 26 14:50:28 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:50:28 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:50:28 user nova-compute[73052]:       <target dev="tapfd15d9bd-b8"/>
Aug 26 14:50:28 user nova-compute[73052]:     </interface>
Aug 26 14:50:28 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:50:28 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/console.log" append="off"/>
Aug 26 14:50:28 user nova-compute[73052]:     </serial>
Aug 26 14:50:28 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:50:28 user nova-compute[73052]:     <video>
Aug 26 14:50:28 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:50:28 user nova-compute[73052]:     </video>
Aug 26 14:50:28 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:50:28 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:50:28 user nova-compute[73052]:     </rng>
Aug 26 14:50:28 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:50:28 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:50:28 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:50:28 user nova-compute[73052]:     </memballoon>
Aug 26 14:50:28 user nova-compute[73052]:   </devices>
Aug 26 14:50:28 user nova-compute[73052]: </domain>
Aug 26 14:50:28 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1401820556-network", "vif_mac": "fa:16:3e:5d:9d:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1401820556-network", "vif_mac": "fa:16:3e:5d:9d:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG os_vif [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd15d9bd-b8, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd15d9bd-b8, col_values=(('external_ids', {'iface-id': 'fd15d9bd-b847-4224-8279-fa3bbb3958b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:9d:ed', 'vm-uuid': '3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:28 user nova-compute[73052]: INFO os_vif [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8')
Aug 26 14:50:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFnbceDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:28 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:28 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:29 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] No VIF found with MAC fa:16:3e:5d:9d:ed, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e06fca-942a-46f3-8713-d5a00e6e71ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:50:29 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c3ef14-a50c-4a14-b90a-c92b66b9e3a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6] added
Aug 26 14:50:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d737825-4e6b-4b96-84e7-91fa1287bc46]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b76066c-afe7-4a2a-a899-74fc64c48bcc]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFnbceDq {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFnbceDq" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b4275c-4e6d-4949-93cb-6693df7cbb9c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aFnbceDq'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb027e56-c60a-41d7-9924-906ef4369f2a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd96fe04-9c71-4ff8-b8e6-b40a147a353d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e6648f-abb0-4505-9919-d111cba06c4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6, portal: 172.16.0.220,3260]
Aug 26 14:50:29 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8722406c-e053-46e3-a2d5-4fa9b017d722]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af053a6-3033-43ec-9d5c-76f990eeaefe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 (non-flash)
Aug 26 14:50:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdccb99a-7335-46a8-a5ac-4fdbca24bec0]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:50:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFnbceDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23464663766663236', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464663766663236', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG nova.objects.instance [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lazy-loading 'flavor' on Instance uuid 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:50:30 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:30 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:50:30 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:50:30 user nova-compute[73052]:   <serial>210eaf10-bf68-4522-b513-913164ea55c6</serial>
Aug 26 14:50:30 user nova-compute[73052]: </disk>
Aug 26 14:50:30 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-5fdf8301-38bb-4374-bb34-dfbcf9335581 req-c993f9f1-02a2-42dd-8495-9d1635bb4f94 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5fdf8301-38bb-4374-bb34-dfbcf9335581 req-c993f9f1-02a2-42dd-8495-9d1635bb4f94 service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5fdf8301-38bb-4374-bb34-dfbcf9335581 req-c993f9f1-02a2-42dd-8495-9d1635bb4f94 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5fdf8301-38bb-4374-bb34-dfbcf9335581 req-c993f9f1-02a2-42dd-8495-9d1635bb4f94 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-5fdf8301-38bb-4374-bb34-dfbcf9335581 req-c993f9f1-02a2-42dd-8495-9d1635bb4f94 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:30 user nova-compute[73052]: WARNING nova.compute.manager [req-5fdf8301-38bb-4374-bb34-dfbcf9335581 req-c993f9f1-02a2-42dd-8495-9d1635bb4f94 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state active and task_state resize_finish.
Aug 26 14:50:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] No VIF found with MAC fa:16:3e:73:bf:27, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-796be7b9-4438-41f5-baa5-b11e62fff6a9 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.857s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:31 user nova-compute[73052]: INFO nova.compute.manager [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Terminating instance
Aug 26 14:50:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Instance destroyed successfully.
Aug 26 14:50:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lazy-loading 'resources' on Instance uuid 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-297620938',display_name='tempest-DeleteServersTestJSON-server-297620938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-297620938',id=21,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='828e21454a0e4cc096cc95718e934697',ramdisk_id='',reservation_id='r-3wr86hwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-402805084',owner_user_name='tempest-DeleteServersTestJSON-402805084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:48:20Z,user_data=None,user_id='e018816042ce4330b8df928c3091c3c7',uuid=23d61b14-f1ce-4dd0-b46a-d61565ba02d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Converting VIF {"id": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "address": "fa:16:3e:73:bf:27", "network": {"id": "7f7be07d-6609-4b26-bd59-0c0a8da0fdf4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1398114860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828e21454a0e4cc096cc95718e934697", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c8e78a-b9", "ovs_interfaceid": "01c8e78a-b9da-48be-a62d-0ad1c12fb669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:bf:27,bridge_name='br-int',has_traffic_filtering=True,id=01c8e78a-b9da-48be-a62d-0ad1c12fb669,network=Network(7f7be07d-6609-4b26-bd59-0c0a8da0fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c8e78a-b9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_vif [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:bf:27,bridge_name='br-int',has_traffic_filtering=True,id=01c8e78a-b9da-48be-a62d-0ad1c12fb669,network=Network(7f7be07d-6609-4b26-bd59-0c0a8da0fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c8e78a-b9') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01c8e78a-b9, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:50:32 user nova-compute[73052]: INFO os_vif [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:bf:27,bridge_name='br-int',has_traffic_filtering=True,id=01c8e78a-b9da-48be-a62d-0ad1c12fb669,network=Network(7f7be07d-6609-4b26-bd59-0c0a8da0fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c8e78a-b9')
Aug 26 14:50:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFnbceDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:32 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6cf7eb-ad5b-402f-a21d-3bb53cc31c09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf9ffa4-a96c-4a62-b074-5e11a218a567]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:32 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:32 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:32 user nova-compute[73052]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 (non-flash)
Aug 26 14:50:32 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:32 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:32 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:32 user nova-compute[73052]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 (non-flash)
Aug 26 14:50:32 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[847dd526-c7d7-4832-b9c9-77f607c011d7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f53bd0-b092-4fe2-9016-c23699c2cdac]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d767273-b0d0-4079-b9dc-019a8912fa1a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b662b-d803-4706-8829-db43a70a6b58]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[97adae6f-19c5-4b09-b0b2-8546845cfb22]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[71166efc-cc9e-4793-8b19-7b03a3cd8c9b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6, portal: 172.16.0.220,3260]
Aug 26 14:50:32 user nova-compute[73052]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:32 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210eaf10-bf68-4522-b513-913164ea55c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca37c5bf-f998-4ae8-8f8e-c67f79cb20fd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] <== disconnect_volume: return (295ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:50:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Deleting instance files /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5_del
Aug 26 14:50:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Deletion of /opt/stack/data/nova/instances/23d61b14-f1ce-4dd0-b46a-d61565ba02d5_del complete
Aug 26 14:50:32 user nova-compute[73052]: INFO nova.compute.manager [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 14:50:32 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:50:32 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:33 user nova-compute[73052]: WARNING nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state active and task_state resize_finish.
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received event network-vif-unplugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] No waiting events found dispatching network-vif-unplugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received event network-vif-unplugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received event network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Acquiring lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] No waiting events found dispatching network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:33 user nova-compute[73052]: WARNING nova.compute.manager [req-278ef327-222b-48f1-8699-751f75eca4e5 req-6f0b04c8-5d40-4ccd-8527-92d416c4c43b service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received unexpected event network-vif-plugged-01c8e78a-b9da-48be-a62d-0ad1c12fb669 for instance with vm_state active and task_state deleting.
Aug 26 14:50:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061433.3538926, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:50:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Resumed (Lifecycle Event)
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:50:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance running successfully.
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Failed to set time: agent not configured {{(pid=73052) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-10c25201-9b6b-4cd7-9cd5-a859189918c2 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] finish_migration finished successfully. {{(pid=73052) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:50:33 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Took 0.54 seconds to deallocate network for instance.
Aug 26 14:50:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061433.3555903, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:50:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Started (Lifecycle Event)
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:50:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 14:50:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-498f9879-e12e-4dbd-92d4-f3c66252a48e req-808d5344-4db1-4caf-9033-a593ebfafbd8 service nova] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Received event network-vif-deleted-01c8e78a-b9da-48be-a62d-0ad1c12fb669 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:34 user nova-compute[73052]: INFO nova.compute.manager [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Took 0.91 seconds to detach 1 volumes for instance.
Aug 26 14:50:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:34 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:50:34 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:50:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:34 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Deleted allocations for instance 23d61b14-f1ce-4dd0-b46a-d61565ba02d5
Aug 26 14:50:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a26c2d6d-97c8-4ba6-9564-7147e0cdade7 tempest-DeleteServersTestJSON-402805084 tempest-DeleteServersTestJSON-402805084-project-member] Lock "23d61b14-f1ce-4dd0-b46a-d61565ba02d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.330s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-208cc20b-3ea9-45c3-9981-872312e14848 req-5f5f144e-db11-4139-9c9b-93ba4488bd4c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-changed-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-208cc20b-3ea9-45c3-9981-872312e14848 req-5f5f144e-db11-4139-9c9b-93ba4488bd4c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Refreshing instance network info cache due to event network-changed-d42c2dcf-f8f8-4178-a32b-faea50050dcf. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-208cc20b-3ea9-45c3-9981-872312e14848 req-5f5f144e-db11-4139-9c9b-93ba4488bd4c service nova] Acquiring lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-208cc20b-3ea9-45c3-9981-872312e14848 req-5f5f144e-db11-4139-9c9b-93ba4488bd4c service nova] Acquired lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-208cc20b-3ea9-45c3-9981-872312e14848 req-5f5f144e-db11-4139-9c9b-93ba4488bd4c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Refreshing network info cache for port d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'flavor' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:40 user nova-compute[73052]: INFO nova.compute.manager [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Attaching volume 6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 to /dev/vdb
Aug 26 14:50:40 user nova-compute[73052]: DEBUG os_brick.utils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec666849-f2da-4c89-ab7b-8847f339fe17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1360fe40-2d20-4594-b935-480acdcf3ae1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c03519-742f-4fc1-a9ae-9bcf8026f85b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee3aa08-a9ff-4d45-9724-22dc82b6c0f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:50:40 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:50:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e9e305-d7a6-428a-817a-d5dd377d14b5]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG os_brick.utils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:40 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating existing volume attachment record: aa421e65-9a13-4459-8cef-050e82b3a2ee {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:50:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-208cc20b-3ea9-45c3-9981-872312e14848 req-5f5f144e-db11-4139-9c9b-93ba4488bd4c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updated VIF entry in instance network info cache for port d42c2dcf-f8f8-4178-a32b-faea50050dcf. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:50:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-208cc20b-3ea9-45c3-9981-872312e14848 req-5f5f144e-db11-4139-9c9b-93ba4488bd4c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-208cc20b-3ea9-45c3-9981-872312e14848 req-5f5f144e-db11-4139-9c9b-93ba4488bd4c service nova] Releasing lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:50:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-81507174-9969-4b94-99cf-896c69ec0bed req-017127bf-0394-478f-bb07-4f814157f884 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-81507174-9969-4b94-99cf-896c69ec0bed req-017127bf-0394-478f-bb07-4f814157f884 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing instance network info cache due to event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:50:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81507174-9969-4b94-99cf-896c69ec0bed req-017127bf-0394-478f-bb07-4f814157f884 service nova] Acquiring lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81507174-9969-4b94-99cf-896c69ec0bed req-017127bf-0394-478f-bb07-4f814157f884 service nova] Acquired lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-81507174-9969-4b94-99cf-896c69ec0bed req-017127bf-0394-478f-bb07-4f814157f884 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:50:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-81507174-9969-4b94-99cf-896c69ec0bed req-017127bf-0394-478f-bb07-4f814157f884 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updated VIF entry in instance network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:50:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-81507174-9969-4b94-99cf-896c69ec0bed req-017127bf-0394-478f-bb07-4f814157f884 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating instance_info_cache with network_info: [{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81507174-9969-4b94-99cf-896c69ec0bed req-017127bf-0394-478f-bb07-4f814157f884 service nova] Releasing lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-5294dd7a-70c4-4d62-92ed-fa748ea3b179 req-3b7d5ec0-31b9-4308-8afa-f3e8cc1c3104 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-5294dd7a-70c4-4d62-92ed-fa748ea3b179 req-3b7d5ec0-31b9-4308-8afa-f3e8cc1c3104 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing instance network info cache due to event network-changed-4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5294dd7a-70c4-4d62-92ed-fa748ea3b179 req-3b7d5ec0-31b9-4308-8afa-f3e8cc1c3104 service nova] Acquiring lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5294dd7a-70c4-4d62-92ed-fa748ea3b179 req-3b7d5ec0-31b9-4308-8afa-f3e8cc1c3104 service nova] Acquired lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.network.neutron [req-5294dd7a-70c4-4d62-92ed-fa748ea3b179 req-3b7d5ec0-31b9-4308-8afa-f3e8cc1c3104 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Refreshing network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:44 user nova-compute[73052]: INFO nova.compute.manager [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Detaching volume b5d8e6df-0e5b-4ac9-b439-8813018e0fc7
Aug 26 14:50:44 user nova-compute[73052]: INFO nova.virt.block_device [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Attempting to driver detach volume b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 from mountpoint /dev/vdb
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Attempting to detach device vdb from instance c35499ba-06cb-443c-b019-5d3f9ea4c04c from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:50:44 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:44 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:50:44 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:50:44 user nova-compute[73052]:   <serial>b5d8e6df-0e5b-4ac9-b439-8813018e0fc7</serial>
Aug 26 14:50:44 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 14:50:44 user nova-compute[73052]: </disk>
Aug 26 14:50:44 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:50:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully detached device vdb from instance c35499ba-06cb-443c-b019-5d3f9ea4c04c from the persistent domain config.
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c35499ba-06cb-443c-b019-5d3f9ea4c04c from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:50:44 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:44 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:50:44 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:50:44 user nova-compute[73052]:   <serial>b5d8e6df-0e5b-4ac9-b439-8813018e0fc7</serial>
Aug 26 14:50:44 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 14:50:44 user nova-compute[73052]: </disk>
Aug 26 14:50:44 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.network.neutron [req-5294dd7a-70c4-4d62-92ed-fa748ea3b179 req-3b7d5ec0-31b9-4308-8afa-f3e8cc1c3104 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updated VIF entry in instance network info cache for port 4db9d139-2df5-4482-9ff6-67939e0d9a32. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.network.neutron [req-5294dd7a-70c4-4d62-92ed-fa748ea3b179 req-3b7d5ec0-31b9-4308-8afa-f3e8cc1c3104 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating instance_info_cache with network_info: [{"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5294dd7a-70c4-4d62-92ed-fa748ea3b179 req-3b7d5ec0-31b9-4308-8afa-f3e8cc1c3104 service nova] Releasing lock "refresh_cache-c35499ba-06cb-443c-b019-5d3f9ea4c04c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061444.8697176, c35499ba-06cb-443c-b019-5d3f9ea4c04c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:50:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully detached device vdb from instance c35499ba-06cb-443c-b019-5d3f9ea4c04c from the live domain config.
Aug 26 14:50:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKseBUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f195b3-7e29-4f0c-b605-3e19aefa23a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f40ca-d697-49b1-8879-0a42027113fe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:44 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:44 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 (non-flash)
Aug 26 14:50:44 user nova-compute[73052]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:44 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0171870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[088b9c49-6b70-4d73-8d8a-8b49b7234d04]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffab429-f278-4dcb-828b-de4536ef1e3e]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:50:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156a575-2d45-419c-94c0-3ba7ecb5f7cd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.321s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2560afc-9002-4704-8cf8-517bd988bc25]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[411ac29a-bfa8-4884-8b60-30658e6fd8b4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b651e21a-2faa-48cd-9f4b-58056dda3139]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260]
Aug 26 14:50:45 user nova-compute[73052]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:45 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d8e6df-0e5b-4ac9-b439-8813018e0fc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[749d3f7e-862c-4f4f-9ea8-09349958eb41]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.602s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] <== disconnect_volume: return (603ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:50:47 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061432.4421053, 23d61b14-f1ce-4dd0-b46a-d61565ba02d5 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:50:47 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] VM Stopped (Lifecycle Event)
Aug 26 14:50:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e7eb0571-56a3-4aa4-b082-864ad610d2c9 None None] [instance: 23d61b14-f1ce-4dd0-b46a-d61565ba02d5] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:50:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:51 user nova-compute[73052]: DEBUG nova.objects.instance [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'flavor' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-00144625-370e-4095-a59d-2626ab2f5047 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.446s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neKokTcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:50:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:50:52 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f492e82-6459-4c7a-87bf-d77e01d4813b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:50:52 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[07572426-b654-41e6-8663-2f45de5d83ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0] added
Aug 26 14:50:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f74c7b-82ca-4058-afd3-a79add573de8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[92016926-3c02-4520-9956-9299933dc8de]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v neKokTcz {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v neKokTcz" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03338b4-99c3-4a69-a06e-a81e5df9e2ff]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'neKokTcz'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a2660-38ca-4bf2-b891-66f362259dc1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0080202b-f5d8-43a7-a1ef-9f9bc29881fd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:52 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:52 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[345995df-4884-44f2-84b5-f72964fc4ecb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0, portal: 172.16.0.220,3260]
Aug 26 14:50:53 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0, portal: 172.16.0.220,3260] successful.
Aug 26 14:50:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee6db0-7304-4c64-a5b1-558cb9ef34ce]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2c14b1-67d2-4c24-8080-12a7b493b2bb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:53 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:53 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:50:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:50:53 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:50:53 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:50:53 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c6af64-292f-45f9-9c08-a5aad2813ed0]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neKokTcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23661393733623832', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661393733623832', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG nova.objects.instance [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'flavor' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:50:54 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:50:54 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:50:54 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:50:54 user nova-compute[73052]:   <serial>6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0</serial>
Aug 26 14:50:54 user nova-compute[73052]: </disk>
Aug 26 14:50:54 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No VIF found with MAC fa:16:3e:17:bc:26, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-21b50874-c865-4af8-a67b-1d4247df99ad tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.040s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:55 user nova-compute[73052]: INFO nova.compute.manager [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Rescuing
Aug 26 14:50:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquired lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:55 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:50:55 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Releasing lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG nova.compute.manager [req-70bf08ec-1e32-40fd-954e-53958fe1ba12 req-55ad7ee4-27bc-4d1e-b524-4ace68b8972d service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-70bf08ec-1e32-40fd-954e-53958fe1ba12 req-55ad7ee4-27bc-4d1e-b524-4ace68b8972d service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-70bf08ec-1e32-40fd-954e-53958fe1ba12 req-55ad7ee4-27bc-4d1e-b524-4ace68b8972d service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-70bf08ec-1e32-40fd-954e-53958fe1ba12 req-55ad7ee4-27bc-4d1e-b524-4ace68b8972d service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG nova.compute.manager [req-70bf08ec-1e32-40fd-954e-53958fe1ba12 req-55ad7ee4-27bc-4d1e-b524-4ace68b8972d service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:56 user nova-compute[73052]: WARNING nova.compute.manager [req-70bf08ec-1e32-40fd-954e-53958fe1ba12 req-55ad7ee4-27bc-4d1e-b524-4ace68b8972d service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state active and task_state rescuing.
Aug 26 14:50:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance destroyed successfully.
Aug 26 14:50:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Attempting rescue
Aug 26 14:50:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73052) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance directory exists: not creating {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 14:50:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Creating image(s)
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.222s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue" returned: 0 in 0.054s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'migration_context' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<2b3a3e44-b6be-4d68-b034-843d74ba9334> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Start _get_guest_xml network_info=[{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:17:bc:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'resources' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<2b3a3e44-b6be-4d68-b034-843d74ba9334> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'numa_topology' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<2b3a3e44-b6be-4d68-b034-843d74ba9334> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:50:57 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:50:57 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<2b3a3e44-b6be-4d68-b034-843d74ba9334> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-883597149',display_name='tempest-ServerRescueNegativeTestJSON-server-883597149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-883597149',id=23,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCDGw/VQjctZ1orDhsFcUzz7rd/4Dd1cG8YisvxzGO2T2XqjX2DilbipG80gJz39D6Eje9bPcXWrWRK9h0UFTmKk1+Lj9whfIwlTyfyDx3BokkGHMhW57eBG0HpzhnvSQ==',key_name='tempest-keypair-672801022',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:48:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-enh4hvpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='966347969be04bb9a69cbdc441a94d8f',uuid=2b3a3e44-b6be-4d68-b034-843d74ba9334,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:17:bc:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "vif_mac": "fa:16:3e:17:bc:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:bc:26,bridge_name='br-int',has_traffic_filtering=True,id=d42c2dcf-f8f8-4178-a32b-faea50050dcf,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c2dcf-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Object Instance<2b3a3e44-b6be-4d68-b034-843d74ba9334> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:50:57 user nova-compute[73052]:   <uuid>2b3a3e44-b6be-4d68-b034-843d74ba9334</uuid>
Aug 26 14:50:57 user nova-compute[73052]:   <name>instance-00000017</name>
Aug 26 14:50:57 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:50:57 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:50:57 user nova-compute[73052]:   <metadata>
Aug 26 14:50:57 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:50:57 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:50:57 user nova-compute[73052]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-883597149</nova:name>
Aug 26 14:50:57 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:50:57</nova:creationTime>
Aug 26 14:50:57 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:50:57 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:50:57 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:50:57 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:50:57 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:50:57 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:50:57 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:50:57 user nova-compute[73052]:       <nova:owner>
Aug 26 14:50:57 user nova-compute[73052]:         <nova:user uuid="966347969be04bb9a69cbdc441a94d8f">tempest-ServerRescueNegativeTestJSON-2104819576-project-member</nova:user>
Aug 26 14:50:57 user nova-compute[73052]:         <nova:project uuid="6426cc5de72e40e4ba4570304328a568">tempest-ServerRescueNegativeTestJSON-2104819576</nova:project>
Aug 26 14:50:57 user nova-compute[73052]:       </nova:owner>
Aug 26 14:50:57 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:50:57 user nova-compute[73052]:       <nova:ports>
Aug 26 14:50:57 user nova-compute[73052]:         <nova:port uuid="d42c2dcf-f8f8-4178-a32b-faea50050dcf">
Aug 26 14:50:57 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 14:50:57 user nova-compute[73052]:         </nova:port>
Aug 26 14:50:57 user nova-compute[73052]:       </nova:ports>
Aug 26 14:50:57 user nova-compute[73052]:     </nova:instance>
Aug 26 14:50:57 user nova-compute[73052]:   </metadata>
Aug 26 14:50:57 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:50:57 user nova-compute[73052]:     <system>
Aug 26 14:50:57 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:50:57 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:50:57 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:50:57 user nova-compute[73052]:       <entry name="serial">2b3a3e44-b6be-4d68-b034-843d74ba9334</entry>
Aug 26 14:50:57 user nova-compute[73052]:       <entry name="uuid">2b3a3e44-b6be-4d68-b034-843d74ba9334</entry>
Aug 26 14:50:57 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:50:57 user nova-compute[73052]:     </system>
Aug 26 14:50:57 user nova-compute[73052]:   </sysinfo>
Aug 26 14:50:57 user nova-compute[73052]:   <os>
Aug 26 14:50:57 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:50:57 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:50:57 user nova-compute[73052]:   </os>
Aug 26 14:50:57 user nova-compute[73052]:   <features>
Aug 26 14:50:57 user nova-compute[73052]:     <acpi/>
Aug 26 14:50:57 user nova-compute[73052]:     <apic/>
Aug 26 14:50:57 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:50:57 user nova-compute[73052]:   </features>
Aug 26 14:50:57 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:50:57 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:50:57 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:50:57 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:50:57 user nova-compute[73052]:   </clock>
Aug 26 14:50:57 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:50:57 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:50:57 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:50:57 user nova-compute[73052]:   </cpu>
Aug 26 14:50:57 user nova-compute[73052]:   <devices>
Aug 26 14:50:57 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:50:57 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:50:57 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue"/>
Aug 26 14:50:57 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:50:57 user nova-compute[73052]:     </disk>
Aug 26 14:50:57 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:50:57 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:50:57 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk"/>
Aug 26 14:50:57 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:50:57 user nova-compute[73052]:     </disk>
Aug 26 14:50:57 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:50:57 user nova-compute[73052]:       <mac address="fa:16:3e:17:bc:26"/>
Aug 26 14:50:57 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:50:57 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:50:57 user nova-compute[73052]:       <target dev="tapd42c2dcf-f8"/>
Aug 26 14:50:57 user nova-compute[73052]:     </interface>
Aug 26 14:50:57 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:50:57 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/console.log" append="off"/>
Aug 26 14:50:57 user nova-compute[73052]:     </serial>
Aug 26 14:50:57 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:50:57 user nova-compute[73052]:     <video>
Aug 26 14:50:57 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:50:57 user nova-compute[73052]:     </video>
Aug 26 14:50:57 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:50:57 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:50:57 user nova-compute[73052]:     </rng>
Aug 26 14:50:57 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:50:57 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:50:57 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:50:57 user nova-compute[73052]:     </memballoon>
Aug 26 14:50:57 user nova-compute[73052]:   </devices>
Aug 26 14:50:57 user nova-compute[73052]: </domain>
Aug 26 14:50:57 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:50:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance destroyed successfully.
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] No VIF found with MAC fa:16:3e:17:bc:26, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:50:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-4994ab07-ff83-4128-acd9-809b9483e74a req-f020646c-0948-40a3-a336-9f9b99d575d5 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:50:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4994ab07-ff83-4128-acd9-809b9483e74a req-f020646c-0948-40a3-a336-9f9b99d575d5 service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:50:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4994ab07-ff83-4128-acd9-809b9483e74a req-f020646c-0948-40a3-a336-9f9b99d575d5 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:50:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4994ab07-ff83-4128-acd9-809b9483e74a req-f020646c-0948-40a3-a336-9f9b99d575d5 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:50:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-4994ab07-ff83-4128-acd9-809b9483e74a req-f020646c-0948-40a3-a336-9f9b99d575d5 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:50:58 user nova-compute[73052]: WARNING nova.compute.manager [req-4994ab07-ff83-4128-acd9-809b9483e74a req-f020646c-0948-40a3-a336-9f9b99d575d5 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state active and task_state rescuing.
Aug 26 14:50:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:50:59 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:00 user nova-compute[73052]: WARNING nova.compute.manager [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state active and task_state rescuing.
Aug 26 14:51:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:00 user nova-compute[73052]: WARNING nova.compute.manager [req-985751c6-2f54-4d36-b68c-5c23e3f9e76c req-c2ceb1c9-80ca-45c0-a935-58bb7ccfb19c service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state active and task_state rescuing.
Aug 26 14:51:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for 2b3a3e44-b6be-4d68-b034-843d74ba9334 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:51:01 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061461.2103498, 2b3a3e44-b6be-4d68-b034-843d74ba9334 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:01 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] VM Resumed (Lifecycle Event)
Aug 26 14:51:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b40dcf63-b6e0-4b28-bc3e-547dcc70166d tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:51:01 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 14:51:01 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061461.2115402, 2b3a3e44-b6be-4d68-b034-843d74ba9334 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:01 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] VM Started (Lifecycle Event)
Aug 26 14:51:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:51:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:51:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:51:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:51:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:51:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:51:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:51:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:05 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:07 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:51:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:10 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:51:10 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:51:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=25.134449005126953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:51:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Applying migration context for instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 as it has an incoming, in-progress migration d2fd62e9-9918-4984-94f2-3806d39e796d. Migration status is finished {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 14:51:10 user nova-compute[73052]: INFO nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating resource usage from migration d2fd62e9-9918-4984-94f2-3806d39e796d
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7e88d68a-33cf-467a-9e55-8162648a2b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c35499ba-06cb-443c-b019-5d3f9ea4c04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Migration d2fd62e9-9918-4984-94f2-3806d39e796d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.852s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 14:51:11 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:51:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:51:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:51:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:51:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:51:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:16 user nova-compute[73052]: INFO nova.compute.manager [None req-4433bb3b-2e9a-47d3-99cd-972b4da40421 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Unrescuing
Aug 26 14:51:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4433bb3b-2e9a-47d3-99cd-972b4da40421 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4433bb3b-2e9a-47d3-99cd-972b4da40421 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquired lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:16 user nova-compute[73052]: DEBUG nova.network.neutron [None req-4433bb3b-2e9a-47d3-99cd-972b4da40421 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:51:16 user nova-compute[73052]: DEBUG nova.network.neutron [None req-4433bb3b-2e9a-47d3-99cd-972b4da40421 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4433bb3b-2e9a-47d3-99cd-972b4da40421 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Releasing lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:16 user nova-compute[73052]: DEBUG nova.objects.instance [None req-4433bb3b-2e9a-47d3-99cd-972b4da40421 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'flavor' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-70a1c110-ed87-4e77-a5a3-3aa70a90a2ca req-df99eab7-51fe-4e86-b07d-78a4d87c8a5d service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-70a1c110-ed87-4e77-a5a3-3aa70a90a2ca req-df99eab7-51fe-4e86-b07d-78a4d87c8a5d service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-70a1c110-ed87-4e77-a5a3-3aa70a90a2ca req-df99eab7-51fe-4e86-b07d-78a4d87c8a5d service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-70a1c110-ed87-4e77-a5a3-3aa70a90a2ca req-df99eab7-51fe-4e86-b07d-78a4d87c8a5d service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-70a1c110-ed87-4e77-a5a3-3aa70a90a2ca req-df99eab7-51fe-4e86-b07d-78a4d87c8a5d service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:17 user nova-compute[73052]: WARNING nova.compute.manager [req-70a1c110-ed87-4e77-a5a3-3aa70a90a2ca req-df99eab7-51fe-4e86-b07d-78a4d87c8a5d service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:17 user nova-compute[73052]: INFO nova.compute.manager [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attaching volume 65058d89-4a1a-441e-aede-7c300a1e03af to /dev/vdb
Aug 26 14:51:17 user nova-compute[73052]: DEBUG os_brick.utils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e646b-bd3d-4c50-9da1-9ad006ffbe03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4b52b0-0c61-468f-9e63-33d78a515f19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[532c1921-e07c-4144-b464-820e8973a43c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0820e3ac-683b-4ed4-a693-17da3f475783]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:51:17 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:51:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b908bdc2-aca6-446d-a83f-a630c99a4bfa]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG os_brick.utils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:51:17 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating existing volume attachment record: 9c50b396-2fe5-4c27-aa62-febef456482e {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:51:17 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance destroyed successfully.
Aug 26 14:51:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-6057f65b-87cc-43b6-b7b7-87bc395210e2 req-5c1ba1ec-45ba-4998-aa48-b08c032787b0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-changed-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-6057f65b-87cc-43b6-b7b7-87bc395210e2 req-5c1ba1ec-45ba-4998-aa48-b08c032787b0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Refreshing instance network info cache due to event network-changed-d5c81e0c-e3d2-42e3-a444-a1730b6d4763. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:51:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6057f65b-87cc-43b6-b7b7-87bc395210e2 req-5c1ba1ec-45ba-4998-aa48-b08c032787b0 service nova] Acquiring lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6057f65b-87cc-43b6-b7b7-87bc395210e2 req-5c1ba1ec-45ba-4998-aa48-b08c032787b0 service nova] Acquired lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:18 user nova-compute[73052]: DEBUG nova.network.neutron [req-6057f65b-87cc-43b6-b7b7-87bc395210e2 req-5c1ba1ec-45ba-4998-aa48-b08c032787b0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Refreshing network info cache for port d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG nova.network.neutron [req-6057f65b-87cc-43b6-b7b7-87bc395210e2 req-5c1ba1ec-45ba-4998-aa48-b08c032787b0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updated VIF entry in instance network info cache for port d5c81e0c-e3d2-42e3-a444-a1730b6d4763. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG nova.network.neutron [req-6057f65b-87cc-43b6-b7b7-87bc395210e2 req-5c1ba1ec-45ba-4998-aa48-b08c032787b0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6057f65b-87cc-43b6-b7b7-87bc395210e2 req-5c1ba1ec-45ba-4998-aa48-b08c032787b0 service nova] Releasing lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-499ea266-a937-4a80-9072-04497f0490ed req-136e241f-a1e6-480b-9016-6064a6e8afd3 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-499ea266-a937-4a80-9072-04497f0490ed req-136e241f-a1e6-480b-9016-6064a6e8afd3 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-499ea266-a937-4a80-9072-04497f0490ed req-136e241f-a1e6-480b-9016-6064a6e8afd3 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-499ea266-a937-4a80-9072-04497f0490ed req-136e241f-a1e6-480b-9016-6064a6e8afd3 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-499ea266-a937-4a80-9072-04497f0490ed req-136e241f-a1e6-480b-9016-6064a6e8afd3 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:19 user nova-compute[73052]: WARNING nova.compute.manager [req-499ea266-a937-4a80-9072-04497f0490ed req-136e241f-a1e6-480b-9016-6064a6e8afd3 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:51:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-5bff4bb5-83cf-478c-b4af-51aea856709c req-97769f95-f1c3-4be5-a0f1-9a1bfea3e4e1 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-changed-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-5bff4bb5-83cf-478c-b4af-51aea856709c req-97769f95-f1c3-4be5-a0f1-9a1bfea3e4e1 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Refreshing instance network info cache due to event network-changed-d5c81e0c-e3d2-42e3-a444-a1730b6d4763. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:51:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bff4bb5-83cf-478c-b4af-51aea856709c req-97769f95-f1c3-4be5-a0f1-9a1bfea3e4e1 service nova] Acquiring lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bff4bb5-83cf-478c-b4af-51aea856709c req-97769f95-f1c3-4be5-a0f1-9a1bfea3e4e1 service nova] Acquired lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-5bff4bb5-83cf-478c-b4af-51aea856709c req-97769f95-f1c3-4be5-a0f1-9a1bfea3e4e1 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Refreshing network info cache for port d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:51:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-5bff4bb5-83cf-478c-b4af-51aea856709c req-97769f95-f1c3-4be5-a0f1-9a1bfea3e4e1 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updated VIF entry in instance network info cache for port d5c81e0c-e3d2-42e3-a444-a1730b6d4763. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:51:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-5bff4bb5-83cf-478c-b4af-51aea856709c req-97769f95-f1c3-4be5-a0f1-9a1bfea3e4e1 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [{"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bff4bb5-83cf-478c-b4af-51aea856709c req-97769f95-f1c3-4be5-a0f1-9a1bfea3e4e1 service nova] Releasing lock "refresh_cache-7e88d68a-33cf-467a-9e55-8162648a2b02" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:21 user nova-compute[73052]: WARNING nova.compute.manager [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:21 user nova-compute[73052]: WARNING nova.compute.manager [req-fe8ef371-7032-4254-bafb-75340e953c2d req-2e6696a5-4a8a-459d-82ca-6f18932177f5 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for 7e88d68a-33cf-467a-9e55-8162648a2b02 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061481.6405096, 7e88d68a-33cf-467a-9e55-8162648a2b02 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:21 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] VM Resumed (Lifecycle Event)
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4433bb3b-2e9a-47d3-99cd-972b4da40421 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-660e0bf4-c6c2-452b-84bc-6eaebfdd4aab req-e9a24d98-70c7-4688-b980-fa4b904b56f2 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-changed-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-660e0bf4-c6c2-452b-84bc-6eaebfdd4aab req-e9a24d98-70c7-4688-b980-fa4b904b56f2 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Refreshing instance network info cache due to event network-changed-008d9525-e93d-40f5-ac18-aa9696c0fd7a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-660e0bf4-c6c2-452b-84bc-6eaebfdd4aab req-e9a24d98-70c7-4688-b980-fa4b904b56f2 service nova] Acquiring lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-660e0bf4-c6c2-452b-84bc-6eaebfdd4aab req-e9a24d98-70c7-4688-b980-fa4b904b56f2 service nova] Acquired lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-660e0bf4-c6c2-452b-84bc-6eaebfdd4aab req-e9a24d98-70c7-4688-b980-fa4b904b56f2 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Refreshing network info cache for port 008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:51:21 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061481.6430862, 7e88d68a-33cf-467a-9e55-8162648a2b02 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:21 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] VM Started (Lifecycle Event)
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:51:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-660e0bf4-c6c2-452b-84bc-6eaebfdd4aab req-e9a24d98-70c7-4688-b980-fa4b904b56f2 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updated VIF entry in instance network info cache for port 008d9525-e93d-40f5-ac18-aa9696c0fd7a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:51:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-660e0bf4-c6c2-452b-84bc-6eaebfdd4aab req-e9a24d98-70c7-4688-b980-fa4b904b56f2 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-660e0bf4-c6c2-452b-84bc-6eaebfdd4aab req-e9a24d98-70c7-4688-b980-fa4b904b56f2 service nova] Releasing lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:51:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:28 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:51:28 user nova-compute[73052]: INFO nova.compute.claims [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Claim successful on node user
Aug 26 14:51:29 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:51:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:51:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:51:29 user nova-compute[73052]: INFO nova.virt.block_device [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Booting with volume 36d0df67-c292-445b-8ecf-c06ec3d43631 at /dev/vda
Aug 26 14:51:29 user nova-compute[73052]: DEBUG nova.policy [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce6cd78a2f7c407983d90a15ffb94967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8ab154558a4521920e05921722db36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce86fa8-257c-4192-9847-d12c4f8d5c83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.033s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8435df1b-2df1-4a89-816e-d3255c225fba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5e44e4-7feb-4a83-bb30-99f5b7747faa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6cd188-e261-4d1d-9c27-9d5f1b786b70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:51:29 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:51:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16d515d-2c8d-41d5-8f82-b3e7bc55e8ef]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Updating existing volume attachment record: fe818571-9930-4782-9f51-22fd4a9564a9 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:51:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:30 user nova-compute[73052]: DEBUG nova.network.neutron [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Successfully created port: 75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:51:30 user nova-compute[73052]: DEBUG nova.network.neutron [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Successfully updated port: 75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquired lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-a7a156af-6fd8-4903-9a82-9480e99f475e req-46d8caa8-a14b-4ede-a2e5-77c827513c0b service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received event network-changed-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-a7a156af-6fd8-4903-9a82-9480e99f475e req-46d8caa8-a14b-4ede-a2e5-77c827513c0b service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Refreshing instance network info cache due to event network-changed-75a40adb-a6f1-417c-a129-41ea989a0334. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a7a156af-6fd8-4903-9a82-9480e99f475e req-46d8caa8-a14b-4ede-a2e5-77c827513c0b service nova] Acquiring lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Updating instance_info_cache with network_info: [{"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Releasing lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Instance network_info: |[{"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a7a156af-6fd8-4903-9a82-9480e99f475e req-46d8caa8-a14b-4ede-a2e5-77c827513c0b service nova] Acquired lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-a7a156af-6fd8-4903-9a82-9480e99f475e req-46d8caa8-a14b-4ede-a2e5-77c827513c0b service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Refreshing network info cache for port 75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-a7a156af-6fd8-4903-9a82-9480e99f475e req-46d8caa8-a14b-4ede-a2e5-77c827513c0b service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Updated VIF entry in instance network info cache for port 75a40adb-a6f1-417c-a129-41ea989a0334. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-a7a156af-6fd8-4903-9a82-9480e99f475e req-46d8caa8-a14b-4ede-a2e5-77c827513c0b service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Updating instance_info_cache with network_info: [{"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a7a156af-6fd8-4903-9a82-9480e99f475e req-46d8caa8-a14b-4ede-a2e5-77c827513c0b service nova] Releasing lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:32 user nova-compute[73052]: INFO nova.compute.manager [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Unshelving
Aug 26 14:51:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'pci_requests' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'numa_topology' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:51:32 user nova-compute[73052]: INFO nova.compute.claims [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Claim successful on node user
Aug 26 14:51:33 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:51:33 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:51:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:33 user nova-compute[73052]: INFO nova.network.neutron [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating port 25613dee-a11d-49c8-aeba-808b01197e7a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquired lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-3e17a1e3-75a1-49f1-86d9-487a6153f2c2 req-91aa022b-0cff-435b-992e-9c3f129d5e91 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-changed-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-3e17a1e3-75a1-49f1-86d9-487a6153f2c2 req-91aa022b-0cff-435b-992e-9c3f129d5e91 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Refreshing instance network info cache due to event network-changed-25613dee-a11d-49c8-aeba-808b01197e7a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3e17a1e3-75a1-49f1-86d9-487a6153f2c2 req-91aa022b-0cff-435b-992e-9c3f129d5e91 service nova] Acquiring lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating instance_info_cache with network_info: [{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Releasing lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:51:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Creating image(s)
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'trusted_certs' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3e17a1e3-75a1-49f1-86d9-487a6153f2c2 req-91aa022b-0cff-435b-992e-9c3f129d5e91 service nova] Acquired lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG nova.network.neutron [req-3e17a1e3-75a1-49f1-86d9-487a6153f2c2 req-91aa022b-0cff-435b-992e-9c3f129d5e91 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Refreshing network info cache for port 25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG nova.objects.base [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<83e00d7a-c0a0-4e39-af7c-c2fb9a564406> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "b4f7a315aaba59d0d96f71a11b591632f917b3ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "b4f7a315aaba59d0d96f71a11b591632f917b3ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab.part --force-share --output=json" returned: 0 in 0.217s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:36 user nova-compute[73052]: DEBUG nova.virt.images [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] 76cdd8ad-f337-4569-bfbc-1e8d9e2f980c was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 14:51:36 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:51:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab.part /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:36 user nova-compute[73052]: DEBUG nova.network.neutron [req-3e17a1e3-75a1-49f1-86d9-487a6153f2c2 req-91aa022b-0cff-435b-992e-9c3f129d5e91 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updated VIF entry in instance network info cache for port 25613dee-a11d-49c8-aeba-808b01197e7a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:51:36 user nova-compute[73052]: DEBUG nova.network.neutron [req-3e17a1e3-75a1-49f1-86d9-487a6153f2c2 req-91aa022b-0cff-435b-992e-9c3f129d5e91 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating instance_info_cache with network_info: [{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3e17a1e3-75a1-49f1-86d9-487a6153f2c2 req-91aa022b-0cff-435b-992e-9c3f129d5e91 service nova] Releasing lock "refresh_cache-83e00d7a-c0a0-4e39-af7c-c2fb9a564406" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab.part /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab.converted" returned: 0 in 1.103s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "b4f7a315aaba59d0d96f71a11b591632f917b3ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.804s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeRiGMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:51:37 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:51:37 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:51:37 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c224e18-5dd0-4105-a6e7-7e280988ff46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:51:37 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4a9d41-e789-4e18-87ee-9eafa951a20d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af] added
Aug 26 14:51:37 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d94532d-04a3-47b4-994a-36d644b19ae6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[498f96b1-c14a-4b55-a6f3-ef839cd684f1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoeRiGMK {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoeRiGMK" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d5c2b-aab1-4495-aa67-791bbc045cf2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoeRiGMK'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[582298b7-e037-44cf-b533-248a188eb0fe]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b4959c-6715-4868-a5f1-95fa88b989dd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:37 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:37 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab --force-share --output=json" returned: 0 in 0.248s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "b4f7a315aaba59d0d96f71a11b591632f917b3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "b4f7a315aaba59d0d96f71a11b591632f917b3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c8872a-0f00-403c-b2d0-b1d5f601afb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af, portal: 172.16.0.220,3260]
Aug 26 14:51:37 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af, portal: 172.16.0.220,3260] successful.
Aug 26 14:51:37 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbd517e-8789-4ecc-8752-eab9948a7985]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d09f19-f12f-40d9-a31f-572ee935e736]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af (non-flash)
Aug 26 14:51:37 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:37 user nova-compute[73052]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af (non-flash)
Aug 26 14:51:37 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022f010-b322-4a34-8dd1-bb8bf1f446eb]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeRiGMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab --force-share --output=json" returned: 0 in 0.204s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab,backing_fmt=raw /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab,backing_fmt=raw /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk 1073741824" returned: 0 in 0.062s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "b4f7a315aaba59d0d96f71a11b591632f917b3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab --force-share --output=json" returned: 0 in 0.217s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'migration_context' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG nova.objects.base [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<83e00d7a-c0a0-4e39-af7c-c2fb9a564406> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:51:38 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Rebasing disk image.
Aug 26 14:51:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.269s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a -F raw /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26136623163313131', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136623163313131', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:51:38 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:51:39 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:51:39 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:51:39 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:51:39 user nova-compute[73052]:   <serial>65058d89-4a1a-441e-aede-7c300a1e03af</serial>
Aug 26 14:51:39 user nova-compute[73052]: </disk>
Aug 26 14:51:39 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:51:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:51:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:51:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] No VIF found with MAC fa:16:3e:51:e9:f0, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:51:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f52bffcd-8887-4e01-8a75-344f20834a5d tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.781s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a -F raw /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk" returned: 0 in 2.443s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Ensure instance console log exists: /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Start _get_guest_xml network_info=[{"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='04b037ae359e9ef0db86174332f0d364',container_format='bare',created_at=2023-08-26T14:49:39Z,direct_url=<?>,disk_format='qcow2',id=76cdd8ad-f337-4569-bfbc-1e8d9e2f980c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-974097995-shelved',owner='267e3757f3624d869a2e5e3d31376b5c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T14:49:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:51:41 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:51:41 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='04b037ae359e9ef0db86174332f0d364',container_format='bare',created_at=2023-08-26T14:49:39Z,direct_url=<?>,disk_format='qcow2',id=76cdd8ad-f337-4569-bfbc-1e8d9e2f980c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-974097995-shelved',owner='267e3757f3624d869a2e5e3d31376b5c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T14:49:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.objects.base [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<83e00d7a-c0a0-4e39-af7c-c2fb9a564406> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-974097995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-974097995',id=20,image_ref='76cdd8ad-f337-4569-bfbc-1e8d9e2f980c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-746986181',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-bawqgpzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member',shelved_at='2023-08-26T14:49:43.693496',shelved_host='user',shelved_image_id='76cdd8ad-f337-4569-bfbc-1e8d9e2f980c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=83e00d7a-c0a0-4e39-af7c-c2fb9a564406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'pci_devices' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.objects.base [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Object Instance<83e00d7a-c0a0-4e39-af7c-c2fb9a564406> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:51:41 user nova-compute[73052]:   <uuid>83e00d7a-c0a0-4e39-af7c-c2fb9a564406</uuid>
Aug 26 14:51:41 user nova-compute[73052]:   <name>instance-00000014</name>
Aug 26 14:51:41 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:51:41 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:51:41 user nova-compute[73052]:   <metadata>
Aug 26 14:51:41 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:51:41 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:51:41 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-974097995</nova:name>
Aug 26 14:51:41 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:51:41</nova:creationTime>
Aug 26 14:51:41 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:51:41 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:51:41 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:51:41 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:51:41 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:51:41 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:51:41 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:51:41 user nova-compute[73052]:       <nova:owner>
Aug 26 14:51:41 user nova-compute[73052]:         <nova:user uuid="e2513642eea3411b9c8c33714bd2f3b3">tempest-AttachVolumeShelveTestJSON-1914851903-project-member</nova:user>
Aug 26 14:51:41 user nova-compute[73052]:         <nova:project uuid="267e3757f3624d869a2e5e3d31376b5c">tempest-AttachVolumeShelveTestJSON-1914851903</nova:project>
Aug 26 14:51:41 user nova-compute[73052]:       </nova:owner>
Aug 26 14:51:41 user nova-compute[73052]:       <nova:root type="image" uuid="76cdd8ad-f337-4569-bfbc-1e8d9e2f980c"/>
Aug 26 14:51:41 user nova-compute[73052]:       <nova:ports>
Aug 26 14:51:41 user nova-compute[73052]:         <nova:port uuid="25613dee-a11d-49c8-aeba-808b01197e7a">
Aug 26 14:51:41 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 14:51:41 user nova-compute[73052]:         </nova:port>
Aug 26 14:51:41 user nova-compute[73052]:       </nova:ports>
Aug 26 14:51:41 user nova-compute[73052]:     </nova:instance>
Aug 26 14:51:41 user nova-compute[73052]:   </metadata>
Aug 26 14:51:41 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:51:41 user nova-compute[73052]:     <system>
Aug 26 14:51:41 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:51:41 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:51:41 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:51:41 user nova-compute[73052]:       <entry name="serial">83e00d7a-c0a0-4e39-af7c-c2fb9a564406</entry>
Aug 26 14:51:41 user nova-compute[73052]:       <entry name="uuid">83e00d7a-c0a0-4e39-af7c-c2fb9a564406</entry>
Aug 26 14:51:41 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:51:41 user nova-compute[73052]:     </system>
Aug 26 14:51:41 user nova-compute[73052]:   </sysinfo>
Aug 26 14:51:41 user nova-compute[73052]:   <os>
Aug 26 14:51:41 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:51:41 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:51:41 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:51:41 user nova-compute[73052]:   </os>
Aug 26 14:51:41 user nova-compute[73052]:   <features>
Aug 26 14:51:41 user nova-compute[73052]:     <acpi/>
Aug 26 14:51:41 user nova-compute[73052]:     <apic/>
Aug 26 14:51:41 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:51:41 user nova-compute[73052]:   </features>
Aug 26 14:51:41 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:51:41 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:51:41 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:51:41 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:51:41 user nova-compute[73052]:   </clock>
Aug 26 14:51:41 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:51:41 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:51:41 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:51:41 user nova-compute[73052]:   </cpu>
Aug 26 14:51:41 user nova-compute[73052]:   <devices>
Aug 26 14:51:41 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:51:41 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:51:41 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk"/>
Aug 26 14:51:41 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:51:41 user nova-compute[73052]:     </disk>
Aug 26 14:51:41 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:51:41 user nova-compute[73052]:       <mac address="fa:16:3e:a7:bd:76"/>
Aug 26 14:51:41 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:51:41 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:51:41 user nova-compute[73052]:       <target dev="tap25613dee-a1"/>
Aug 26 14:51:41 user nova-compute[73052]:     </interface>
Aug 26 14:51:41 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:51:41 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/console.log" append="off"/>
Aug 26 14:51:41 user nova-compute[73052]:     </serial>
Aug 26 14:51:41 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:51:41 user nova-compute[73052]:     <video>
Aug 26 14:51:41 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:51:41 user nova-compute[73052]:     </video>
Aug 26 14:51:41 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:51:41 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:51:41 user nova-compute[73052]:     </rng>
Aug 26 14:51:41 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:51:41 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:51:41 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:51:41 user nova-compute[73052]:     </memballoon>
Aug 26 14:51:41 user nova-compute[73052]:   </devices>
Aug 26 14:51:41 user nova-compute[73052]: </domain>
Aug 26 14:51:41 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-974097995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-974097995',id=20,image_ref='76cdd8ad-f337-4569-bfbc-1e8d9e2f980c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-746986181',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-bawqgpzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member',shelved_at='2023-08-26T14:49:43.693496',shelved_host='user',shelved_image_id='76cdd8ad-f337-4569-bfbc-1e8d9e2f980c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=83e00d7a-c0a0-4e39-af7c-c2fb9a564406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG os_vif [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25613dee-a1, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25613dee-a1, col_values=(('external_ids', {'iface-id': '25613dee-a11d-49c8-aeba-808b01197e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:bd:76', 'vm-uuid': '83e00d7a-c0a0-4e39-af7c-c2fb9a564406'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:41 user nova-compute[73052]: INFO os_vif [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1')
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:51:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] No VIF found with MAC fa:16:3e:a7:bd:76, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:42 user nova-compute[73052]: INFO nova.compute.manager [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Detaching volume 65058d89-4a1a-441e-aede-7c300a1e03af
Aug 26 14:51:42 user nova-compute[73052]: INFO nova.virt.block_device [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Attempting to driver detach volume 65058d89-4a1a-441e-aede-7c300a1e03af from mountpoint /dev/vdb
Aug 26 14:51:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Attempting to detach device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:51:42 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:51:42 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:51:42 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:51:42 user nova-compute[73052]:   <serial>65058d89-4a1a-441e-aede-7c300a1e03af</serial>
Aug 26 14:51:42 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:51:42 user nova-compute[73052]: </disk>
Aug 26 14:51:42 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:51:42 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully detached device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the persistent domain config.
Aug 26 14:51:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:51:42 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:51:42 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 14:51:42 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:51:42 user nova-compute[73052]:   <serial>65058d89-4a1a-441e-aede-7c300a1e03af</serial>
Aug 26 14:51:42 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:51:42 user nova-compute[73052]: </disk>
Aug 26 14:51:42 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:42 user nova-compute[73052]: INFO nova.compute.manager [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Terminating instance
Aug 26 14:51:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-de57133e-45fd-4b00-8a29-bbfa37b7e353 req-7c4639df-861b-405c-bd95-38f2c502b88b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de57133e-45fd-4b00-8a29-bbfa37b7e353 req-7c4639df-861b-405c-bd95-38f2c502b88b service nova] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de57133e-45fd-4b00-8a29-bbfa37b7e353 req-7c4639df-861b-405c-bd95-38f2c502b88b service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de57133e-45fd-4b00-8a29-bbfa37b7e353 req-7c4639df-861b-405c-bd95-38f2c502b88b service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-de57133e-45fd-4b00-8a29-bbfa37b7e353 req-7c4639df-861b-405c-bd95-38f2c502b88b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] No waiting events found dispatching network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:43 user nova-compute[73052]: WARNING nova.compute.manager [req-de57133e-45fd-4b00-8a29-bbfa37b7e353 req-7c4639df-861b-405c-bd95-38f2c502b88b service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received unexpected event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061503.1383955, 92558f0f-dc80-4acf-b3b9-27d0244c0ddb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:51:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully detached device vdb from instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb from the live domain config.
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeRiGMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:51:43 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-f040e920-2f88-4bb1-965c-0e1a8aaf99af req-153dbb85-9be4-4de3-936a-673be8b12c45 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-unplugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f040e920-2f88-4bb1-965c-0e1a8aaf99af req-153dbb85-9be4-4de3-936a-673be8b12c45 service nova] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f040e920-2f88-4bb1-965c-0e1a8aaf99af req-153dbb85-9be4-4de3-936a-673be8b12c45 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f040e920-2f88-4bb1-965c-0e1a8aaf99af req-153dbb85-9be4-4de3-936a-673be8b12c45 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-f040e920-2f88-4bb1-965c-0e1a8aaf99af req-153dbb85-9be4-4de3-936a-673be8b12c45 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] No waiting events found dispatching network-vif-unplugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-f040e920-2f88-4bb1-965c-0e1a8aaf99af req-153dbb85-9be4-4de3-936a-673be8b12c45 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-unplugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:51:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Creating image(s)
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Ensure instance console log exists: /opt/stack/data/nova/instances/7acb8d8e-f559-412c-91b3-e20f2df2a09a/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Start _get_guest_xml network_info=[{"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'fe818571-9930-4782-9f51-22fd4a9564a9', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjIUZgpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7acb8d8e-f559-412c-91b3-e20f2df2a09a', 'attached_at': '', 'detached_at': '', 'volume_id': '36d0df67-c292-445b-8ecf-c06ec3d43631', 'serial': '36d0df67-c292-445b-8ecf-c06ec3d43631'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec7230-3c58-4eef-9924-3065ef05b668]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:51:43 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjIUZgpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:51:43 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[40385d87-30cf-4fe5-97c5-5a41dea65023]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af (non-flash)
Aug 26 14:51:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af (non-flash)
Aug 26 14:51:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01f1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec2d61-0088-4773-940d-e15b48f40ef3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e756a5-047a-4a51-a791-2fc581d33483]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5736f309-6f96-4b69-8aca-06b4dc61c0e5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c4084b-b1c6-4049-b5e6-c1fba9c7d693]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62e52af-c9eb-4024-8ff5-3c9b8666181c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc21be4-0946-4f15-91e0-d1e82cf85033]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af, portal: 172.16.0.220,3260]
Aug 26 14:51:43 user nova-compute[73052]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af, portal: 172.16.0.220,3260] successful.
Aug 26 14:51:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65058d89-4a1a-441e-aede-7c300a1e03af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4dad46-d362-4ef5-a050-150e56cb3c30]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] <== disconnect_volume: return (416ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.328s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:51:43 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:51:43 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334d76c-2852-4e25-a1a5-379db947142b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:51:43 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[825260f6-580a-4af2-a133-ba63c6586efb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631] added
Aug 26 14:51:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8663d33-5319-43cd-bce4-f4393d9599c1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[75460955-54df-4dd9-9b4a-a5e6b33cafcf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjIUZgpT {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjIUZgpT" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a2e65b-0efe-4faa-b487-3493375de79c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BjIUZgpT'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ddefd5-93f8-4036-84d7-25963473113f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd54c90-c7a3-4ba3-844a-fac4acf337cf]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:43 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Instance destroyed successfully.
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'resources' on Instance uuid c35499ba-06cb-443c-b019-5d3f9ea4c04c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1176116480',display_name='tempest-TestMinimumBasicScenario-server-1176116480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1176116480',id=18,image_ref='34627f75-187c-44f2-9749-4cc1345cfced',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAMSIyDQ1VQy6BQTJ0WjR355nHpIHxZhWS7n7EqmhMZh7KAKhqSTSs8c0BrvxrQWpXyJiDHkm6unDULTP4wmzzGpXNR641qX59KqYrTwsK1Es0nLuwmp1AY4EAqHHQW7g==',key_name='tempest-TestMinimumBasicScenario-560329351',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-x02axkt3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34627f75-187c-44f2-9749-4cc1345cfced',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:48:59Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=c35499ba-06cb-443c-b019-5d3f9ea4c04c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "address": "fa:16:3e:1f:a8:07", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4db9d139-2d", "ovs_interfaceid": "4db9d139-2df5-4482-9ff6-67939e0d9a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_vif [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4db9d139-2d, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:43 user nova-compute[73052]: INFO os_vif [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=4db9d139-2df5-4482-9ff6-67939e0d9a32,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4db9d139-2d')
Aug 26 14:51:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Deleting instance files /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c_del
Aug 26 14:51:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Deletion of /opt/stack/data/nova/instances/c35499ba-06cb-443c-b019-5d3f9ea4c04c_del complete
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d2aeb9-b61a-4d30-9b4f-5b0628868d6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631, portal: 172.16.0.220,3260]
Aug 26 14:51:43 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631, portal: 172.16.0.220,3260] successful.
Aug 26 14:51:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921e1ca-9661-48f7-b96e-cc23c4fefb14]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b11b79-1998-46bc-8819-b69eba4c2e76]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:44 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:44 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:44 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:51:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:44 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:44 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:44 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:51:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:51:44 user nova-compute[73052]: INFO nova.compute.manager [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b86e478-6fcd-409b-b98f-99f0fd310b19]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'flavor' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:44 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Took 0.67 seconds to deallocate network for instance.
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2396d0a9-ebd8-40b7-b538-e9d209c5d7c0 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.653s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjIUZgpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== connect_volume: return (1795ms) {'type': 'block', 'scsi_wwn': '23339653430623831', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339653430623831', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:51:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1065386742',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1065386742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1065386742',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXjfLsGlfK0zuSRneP+pI7xTfQX69+QNDzYWbG2m0lP+hNfpYp5qgb4dp0wAZ/idUeKvVL5FnAxGTmbJLXD+K9SmMQozuBAWdnmMse9VQ9OkCQzQT9LEADIxP1DpVOYDg==',key_name='tempest-keypair-1340868528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-li7dhk3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=7acb8d8e-f559-412c-91b3-e20f2df2a09a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:3d:9d,bridge_name='br-int',has_traffic_filtering=True,id=75a40adb-a6f1-417c-a129-41ea989a0334,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a40adb-a6') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'pci_devices' on Instance uuid 7acb8d8e-f559-412c-91b3-e20f2df2a09a {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:51:45 user nova-compute[73052]:   <uuid>7acb8d8e-f559-412c-91b3-e20f2df2a09a</uuid>
Aug 26 14:51:45 user nova-compute[73052]:   <name>instance-00000019</name>
Aug 26 14:51:45 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:51:45 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:51:45 user nova-compute[73052]:   <metadata>
Aug 26 14:51:45 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:51:45 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:51:45 user nova-compute[73052]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1065386742</nova:name>
Aug 26 14:51:45 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:51:43</nova:creationTime>
Aug 26 14:51:45 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:51:45 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:51:45 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:51:45 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:51:45 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:51:45 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:51:45 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:51:45 user nova-compute[73052]:       <nova:owner>
Aug 26 14:51:45 user nova-compute[73052]:         <nova:user uuid="ce6cd78a2f7c407983d90a15ffb94967">tempest-TestVolumeBootPattern-772605316-project-member</nova:user>
Aug 26 14:51:45 user nova-compute[73052]:         <nova:project uuid="1e8ab154558a4521920e05921722db36">tempest-TestVolumeBootPattern-772605316</nova:project>
Aug 26 14:51:45 user nova-compute[73052]:       </nova:owner>
Aug 26 14:51:45 user nova-compute[73052]:       <nova:ports>
Aug 26 14:51:45 user nova-compute[73052]:         <nova:port uuid="75a40adb-a6f1-417c-a129-41ea989a0334">
Aug 26 14:51:45 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 14:51:45 user nova-compute[73052]:         </nova:port>
Aug 26 14:51:45 user nova-compute[73052]:       </nova:ports>
Aug 26 14:51:45 user nova-compute[73052]:     </nova:instance>
Aug 26 14:51:45 user nova-compute[73052]:   </metadata>
Aug 26 14:51:45 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:51:45 user nova-compute[73052]:     <system>
Aug 26 14:51:45 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:51:45 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:51:45 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:51:45 user nova-compute[73052]:       <entry name="serial">7acb8d8e-f559-412c-91b3-e20f2df2a09a</entry>
Aug 26 14:51:45 user nova-compute[73052]:       <entry name="uuid">7acb8d8e-f559-412c-91b3-e20f2df2a09a</entry>
Aug 26 14:51:45 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:51:45 user nova-compute[73052]:     </system>
Aug 26 14:51:45 user nova-compute[73052]:   </sysinfo>
Aug 26 14:51:45 user nova-compute[73052]:   <os>
Aug 26 14:51:45 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:51:45 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:51:45 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:51:45 user nova-compute[73052]:   </os>
Aug 26 14:51:45 user nova-compute[73052]:   <features>
Aug 26 14:51:45 user nova-compute[73052]:     <acpi/>
Aug 26 14:51:45 user nova-compute[73052]:     <apic/>
Aug 26 14:51:45 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:51:45 user nova-compute[73052]:   </features>
Aug 26 14:51:45 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:51:45 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:51:45 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:51:45 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:51:45 user nova-compute[73052]:   </clock>
Aug 26 14:51:45 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:51:45 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:51:45 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:51:45 user nova-compute[73052]:   </cpu>
Aug 26 14:51:45 user nova-compute[73052]:   <devices>
Aug 26 14:51:45 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:51:45 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:51:45 user nova-compute[73052]:       <source dev="/dev/sde"/>
Aug 26 14:51:45 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:51:45 user nova-compute[73052]:       <serial>36d0df67-c292-445b-8ecf-c06ec3d43631</serial>
Aug 26 14:51:45 user nova-compute[73052]:     </disk>
Aug 26 14:51:45 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:51:45 user nova-compute[73052]:       <mac address="fa:16:3e:40:3d:9d"/>
Aug 26 14:51:45 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:51:45 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:51:45 user nova-compute[73052]:       <target dev="tap75a40adb-a6"/>
Aug 26 14:51:45 user nova-compute[73052]:     </interface>
Aug 26 14:51:45 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:51:45 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/7acb8d8e-f559-412c-91b3-e20f2df2a09a/console.log" append="off"/>
Aug 26 14:51:45 user nova-compute[73052]:     </serial>
Aug 26 14:51:45 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:51:45 user nova-compute[73052]:     <video>
Aug 26 14:51:45 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:51:45 user nova-compute[73052]:     </video>
Aug 26 14:51:45 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:51:45 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:51:45 user nova-compute[73052]:     </rng>
Aug 26 14:51:45 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:51:45 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:51:45 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:51:45 user nova-compute[73052]:     </memballoon>
Aug 26 14:51:45 user nova-compute[73052]:   </devices>
Aug 26 14:51:45 user nova-compute[73052]: </domain>
Aug 26 14:51:45 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:51:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1065386742',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1065386742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1065386742',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXjfLsGlfK0zuSRneP+pI7xTfQX69+QNDzYWbG2m0lP+hNfpYp5qgb4dp0wAZ/idUeKvVL5FnAxGTmbJLXD+K9SmMQozuBAWdnmMse9VQ9OkCQzQT9LEADIxP1DpVOYDg==',key_name='tempest-keypair-1340868528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-li7dhk3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=7acb8d8e-f559-412c-91b3-e20f2df2a09a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:3d:9d,bridge_name='br-int',has_traffic_filtering=True,id=75a40adb-a6f1-417c-a129-41ea989a0334,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a40adb-a6') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG os_vif [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:3d:9d,bridge_name='br-int',has_traffic_filtering=True,id=75a40adb-a6f1-417c-a129-41ea989a0334,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a40adb-a6') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a40adb-a6, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75a40adb-a6, col_values=(('external_ids', {'iface-id': '75a40adb-a6f1-417c-a129-41ea989a0334', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:3d:9d', 'vm-uuid': '7acb8d8e-f559-412c-91b3-e20f2df2a09a'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:45 user nova-compute[73052]: INFO os_vif [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:3d:9d,bridge_name='br-int',has_traffic_filtering=True,id=75a40adb-a6f1-417c-a129-41ea989a0334,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a40adb-a6')
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-f954e409-f038-4bc8-9536-0b0a6d3117ac req-2ecebcfc-4223-4dde-948b-ced40de23475 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f954e409-f038-4bc8-9536-0b0a6d3117ac req-2ecebcfc-4223-4dde-948b-ced40de23475 service nova] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f954e409-f038-4bc8-9536-0b0a6d3117ac req-2ecebcfc-4223-4dde-948b-ced40de23475 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f954e409-f038-4bc8-9536-0b0a6d3117ac req-2ecebcfc-4223-4dde-948b-ced40de23475 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-f954e409-f038-4bc8-9536-0b0a6d3117ac req-2ecebcfc-4223-4dde-948b-ced40de23475 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] No waiting events found dispatching network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:45 user nova-compute[73052]: WARNING nova.compute.manager [req-f954e409-f038-4bc8-9536-0b0a6d3117ac req-2ecebcfc-4223-4dde-948b-ced40de23475 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received unexpected event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-f954e409-f038-4bc8-9536-0b0a6d3117ac req-2ecebcfc-4223-4dde-948b-ced40de23475 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-deleted-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-d8654f21-95dd-4ed6-b462-f4685f9ba8cb req-bb016b85-19c8-4536-b075-0af93c10a019 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d8654f21-95dd-4ed6-b462-f4685f9ba8cb req-bb016b85-19c8-4536-b075-0af93c10a019 service nova] Acquiring lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d8654f21-95dd-4ed6-b462-f4685f9ba8cb req-bb016b85-19c8-4536-b075-0af93c10a019 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d8654f21-95dd-4ed6-b462-f4685f9ba8cb req-bb016b85-19c8-4536-b075-0af93c10a019 service nova] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-d8654f21-95dd-4ed6-b462-f4685f9ba8cb req-bb016b85-19c8-4536-b075-0af93c10a019 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] No waiting events found dispatching network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:45 user nova-compute[73052]: WARNING nova.compute.manager [req-d8654f21-95dd-4ed6-b462-f4685f9ba8cb req-bb016b85-19c8-4536-b075-0af93c10a019 service nova] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Received unexpected event network-vif-plugged-4db9d139-2df5-4482-9ff6-67939e0d9a32 for instance with vm_state deleted and task_state None.
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No VIF found with MAC fa:16:3e:40:3d:9d, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:45 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Deleted allocations for instance c35499ba-06cb-443c-b019-5d3f9ea4c04c
Aug 26 14:51:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d2b085cd-2c9a-4d0e-832a-7f7d9003330e tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "c35499ba-06cb-443c-b019-5d3f9ea4c04c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.718s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061505.888854, 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] VM Resumed (Lifecycle Event)
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:51:45 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance spawned successfully.
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:51:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061505.8890111, 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] VM Started (Lifecycle Event)
Aug 26 14:51:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:51:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:51:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd9d2781-b8cf-4530-a72c-ae369fdc9f94 tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.739s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-84e23a15-31ce-482b-875b-1c441cb58ae8 req-0140e6f4-c604-4776-a9ee-c547ad252aed service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received event network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-84e23a15-31ce-482b-875b-1c441cb58ae8 req-0140e6f4-c604-4776-a9ee-c547ad252aed service nova] Acquiring lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-84e23a15-31ce-482b-875b-1c441cb58ae8 req-0140e6f4-c604-4776-a9ee-c547ad252aed service nova] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-84e23a15-31ce-482b-875b-1c441cb58ae8 req-0140e6f4-c604-4776-a9ee-c547ad252aed service nova] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-84e23a15-31ce-482b-875b-1c441cb58ae8 req-0140e6f4-c604-4776-a9ee-c547ad252aed service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] No waiting events found dispatching network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:47 user nova-compute[73052]: WARNING nova.compute.manager [req-84e23a15-31ce-482b-875b-1c441cb58ae8 req-0140e6f4-c604-4776-a9ee-c547ad252aed service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received unexpected event network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 for instance with vm_state building and task_state spawning.
Aug 26 14:51:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061509.0798686, 7acb8d8e-f559-412c-91b3-e20f2df2a09a => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] VM Resumed (Lifecycle Event)
Aug 26 14:51:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Instance spawned successfully.
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:51:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061509.0858827, 7acb8d8e-f559-412c-91b3-e20f2df2a09a => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] VM Started (Lifecycle Event)
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:51:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:51:49 user nova-compute[73052]: INFO nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:49 user nova-compute[73052]: INFO nova.compute.manager [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Took 20.63 seconds to build instance.
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-221aa176-50c0-4a29-9074-d18611b2e2f7 req-c04e62e8-d1b4-4478-b704-752a6b2dce4e service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received event network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-221aa176-50c0-4a29-9074-d18611b2e2f7 req-c04e62e8-d1b4-4478-b704-752a6b2dce4e service nova] Acquiring lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-221aa176-50c0-4a29-9074-d18611b2e2f7 req-c04e62e8-d1b4-4478-b704-752a6b2dce4e service nova] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-221aa176-50c0-4a29-9074-d18611b2e2f7 req-c04e62e8-d1b4-4478-b704-752a6b2dce4e service nova] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-221aa176-50c0-4a29-9074-d18611b2e2f7 req-c04e62e8-d1b4-4478-b704-752a6b2dce4e service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] No waiting events found dispatching network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:51:49 user nova-compute[73052]: WARNING nova.compute.manager [req-221aa176-50c0-4a29-9074-d18611b2e2f7 req-c04e62e8-d1b4-4478-b704-752a6b2dce4e service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received unexpected event network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 for instance with vm_state active and task_state None.
Aug 26 14:51:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-11ba0e42-0e90-4065-a46d-f091dab3fd81 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.774s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:50 user nova-compute[73052]: INFO nova.compute.manager [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Detaching volume 1657e423-afb0-40aa-b1eb-9ce6ff3148ad
Aug 26 14:51:50 user nova-compute[73052]: INFO nova.virt.block_device [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Attempting to driver detach volume 1657e423-afb0-40aa-b1eb-9ce6ff3148ad from mountpoint /dev/vdb
Aug 26 14:51:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Attempting to detach device vdb from instance 7e88d68a-33cf-467a-9e55-8162648a2b02 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:51:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:51:50 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:51:50 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:51:50 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:51:50 user nova-compute[73052]:   <serial>1657e423-afb0-40aa-b1eb-9ce6ff3148ad</serial>
Aug 26 14:51:50 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:51:50 user nova-compute[73052]: </disk>
Aug 26 14:51:50 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:51:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Successfully detached device vdb from instance 7e88d68a-33cf-467a-9e55-8162648a2b02 from the persistent domain config.
Aug 26 14:51:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e88d68a-33cf-467a-9e55-8162648a2b02 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:51:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:51:50 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:51:50 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:51:50 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:51:50 user nova-compute[73052]:   <serial>1657e423-afb0-40aa-b1eb-9ce6ff3148ad</serial>
Aug 26 14:51:50 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:51:50 user nova-compute[73052]: </disk>
Aug 26 14:51:50 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:51:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061510.9929364, 7e88d68a-33cf-467a-9e55-8162648a2b02 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:51:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:51:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Successfully detached device vdb from instance 7e88d68a-33cf-467a-9e55-8162648a2b02 from the live domain config.
Aug 26 14:51:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIKdwuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:51:51 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d755d-7899-495e-bc88-69ce8edc1fa7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92d895-c1ad-4f96-9e21-4feaf1327cea]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:51 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:51 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:51 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:51:51 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad (non-flash)
Aug 26 14:51:51 user nova-compute[73052]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:51 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:51 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:51:51 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c732170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b91ebb2-d268-4411-a58c-611aa6c7b2c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a8d333-a0b1-448c-b430-c5e3b1211c0f]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ed990-e005-4e6d-bd3f-6bf2180beadf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcabd78a-8058-48cd-bccb-ef983341c58c]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[99880873-f29a-4957-8623-6cf544ff57be]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[960d02d7-ff37-42f1-8024-92b35cc08d61]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad, portal: 172.16.0.220,3260]
Aug 26 14:51:51 user nova-compute[73052]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad, portal: 172.16.0.220,3260] successful.
Aug 26 14:51:51 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1657e423-afb0-40aa-b1eb-9ce6ff3148ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca60e08-cc2b-4c83-aed4-f63b26432e9b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] <== disconnect_volume: return (389ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:51:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:51:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'flavor' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-53970998-3ab8-438b-8b7f-2f7bd66dbc71 tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.060s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:51:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Port fd15d9bd-b847-4224-8279-fa3bbb3958b9 binding to destination host user is already ACTIVE {{(pid=73052) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 14:51:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:51:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquired lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:51:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:51:58 user nova-compute[73052]: DEBUG nova.network.neutron [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:51:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Releasing lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:51:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Creating tmpfile /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/tmpjskdhdp5 to verify with other compute node that the instance is on the same shared storage. {{(pid=73052) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 14:51:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:58 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061503.83427, c35499ba-06cb-443c-b019-5d3f9ea4c04c => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:51:58 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] VM Stopped (Lifecycle Event)
Aug 26 14:51:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bfe73f28-a2cc-4b53-ac04-89e7e50868a0 None None] [instance: c35499ba-06cb-443c-b019-5d3f9ea4c04c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:59 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance destroyed successfully.
Aug 26 14:51:59 user nova-compute[73052]: DEBUG nova.objects.instance [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lazy-loading 'resources' on Instance uuid 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_vif [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd15d9bd-b8, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:59 user nova-compute[73052]: INFO os_vif [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8')
Aug 26 14:51:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:51:59 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b448007-4785-4386-8864-2cea6df4df08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cd1ea7-6ddd-4ed3-acfe-4b85d5da3093]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:59 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:59 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:51:59 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:51:59 user nova-compute[73052]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:51:59 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:51:59 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c6eed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c78da-6c1b-494c-a205-0050271e9371]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5716c99-e890-40a2-9a99-e712c4de60a9]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8fb9ee-2ed8-4c64-a3d3-6f19f8d3932e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7507e6-359f-41f7-a7a9-038e6333b280]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cd14f7-048a-4b9f-a0e0-c68efc582b7e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f6548-ced7-46f4-aaef-ee2874754639]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]
Aug 26 14:51:59 user nova-compute[73052]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.
Aug 26 14:51:59 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d974426-a8b1-4c52-9841-157d4424ae74]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== disconnect_volume: return (364ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:51:59 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:51:59 user nova-compute[73052]: INFO nova.compute.claims [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Claim successful on node user
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-2d8f1b86-296e-4aef-9010-040b0d7240d5 req-8788b270-f738-42c1-88ae-6a408f273ac6 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2d8f1b86-296e-4aef-9010-040b0d7240d5 req-8788b270-f738-42c1-88ae-6a408f273ac6 service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2d8f1b86-296e-4aef-9010-040b0d7240d5 req-8788b270-f738-42c1-88ae-6a408f273ac6 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2d8f1b86-296e-4aef-9010-040b0d7240d5 req-8788b270-f738-42c1-88ae-6a408f273ac6 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-2d8f1b86-296e-4aef-9010-040b0d7240d5 req-8788b270-f738-42c1-88ae-6a408f273ac6 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:00 user nova-compute[73052]: WARNING nova.compute.manager [req-2d8f1b86-296e-4aef-9010-040b0d7240d5 req-8788b270-f738-42c1-88ae-6a408f273ac6 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state resized and task_state resize_reverting.
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:52:00 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.policy [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed5225f2064f43e893a054c3583a0b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1afa5dd9c74414a874e103410b71be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:52:00 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Creating image(s)
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "/opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "/opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.217s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.231s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk 1073741824" returned: 0 in 0.060s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.network.neutron [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Successfully created port: 2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.objects.instance [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lazy-loading 'migration_context' on Instance uuid 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.objects.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Object Instance<3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6> lazy-loaded attributes: resources,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.222s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Cannot resize image /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Ensure instance console log exists: /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:52:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.545s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:02 user nova-compute[73052]: INFO nova.compute.manager [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Swapping old allocation on dict_keys(['63e4ae70-0fae-4216-9a6e-92eef5558363']) held by migration d2fd62e9-9918-4984-94f2-3806d39e796d for instance
Aug 26 14:52:02 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updating instance_info_cache with network_info: [{"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-eb6033f4-da59-4900-a67f-1e244631f046" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Overwriting current allocation {'allocations': {'63e4ae70-0fae-4216-9a6e-92eef5558363': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': '9dbc99e80f5340d0ab8b4c7fe2d0a0c1', 'user_id': 'bb9db00a77d444f791cccb1be3d9150c', 'consumer_generation': 1} on consumer 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquired lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG nova.network.neutron [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG nova.compute.manager [req-b19523b0-e136-4e9d-9ff5-18cf173402ce req-bf2e3469-b47a-475c-afd2-c33315f608eb service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b19523b0-e136-4e9d-9ff5-18cf173402ce req-bf2e3469-b47a-475c-afd2-c33315f608eb service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b19523b0-e136-4e9d-9ff5-18cf173402ce req-bf2e3469-b47a-475c-afd2-c33315f608eb service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b19523b0-e136-4e9d-9ff5-18cf173402ce req-bf2e3469-b47a-475c-afd2-c33315f608eb service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:02 user nova-compute[73052]: DEBUG nova.compute.manager [req-b19523b0-e136-4e9d-9ff5-18cf173402ce req-bf2e3469-b47a-475c-afd2-c33315f608eb service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:02 user nova-compute[73052]: WARNING nova.compute.manager [req-b19523b0-e136-4e9d-9ff5-18cf173402ce req-bf2e3469-b47a-475c-afd2-c33315f608eb service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state resized and task_state resize_reverting.
Aug 26 14:52:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Releasing lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG os_brick.utils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7a97f7-5641-4a49-bc8f-0b1aa6995c58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6079f62c-88e9-42a7-9ee5-7cd20a23f3c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb6778a-6c0f-4f1c-8721-5309bd9a4417]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acaf16a-cf9a-4e57-a3d8-bf05c695794e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:52:03 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35b9bc7-e0de-4ebe-b581-769f91a7694d]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG os_brick.utils [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Successfully updated port: 2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "refresh_cache-8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquired lock "refresh_cache-8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-02fa362b-adca-4ea0-a845-a9fe3e75fc0c req-dda1467b-26bc-4e95-95c1-2b42fc380248 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received event network-changed-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-02fa362b-adca-4ea0-a845-a9fe3e75fc0c req-dda1467b-26bc-4e95-95c1-2b42fc380248 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Refreshing instance network info cache due to event network-changed-2d056b65-479a-43d0-96d1-9c53377bea9e. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-02fa362b-adca-4ea0-a845-a9fe3e75fc0c req-dda1467b-26bc-4e95-95c1-2b42fc380248 service nova] Acquiring lock "refresh_cache-8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.network.neutron [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Updating instance_info_cache with network_info: [{"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Releasing lock "refresh_cache-8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Instance network_info: |[{"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-02fa362b-adca-4ea0-a845-a9fe3e75fc0c req-dda1467b-26bc-4e95-95c1-2b42fc380248 service nova] Acquired lock "refresh_cache-8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.network.neutron [req-02fa362b-adca-4ea0-a845-a9fe3e75fc0c req-dda1467b-26bc-4e95-95c1-2b42fc380248 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Refreshing network info cache for port 2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Start _get_guest_xml network_info=[{"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:52:04 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:52:04 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:51:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-607164700',display_name='tempest-VolumesActionsTest-instance-607164700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-607164700',id=26,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c1afa5dd9c74414a874e103410b71be',ramdisk_id='',reservation_id='r-rnl9fdkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775568266',owner_user_name='tempest-VolumesActionsTest-1775568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:01Z,user_data=None,user_id='ed5225f2064f43e893a054c3583a0b8f',uuid=8c5ecea5-aa8d-4743-9109-cab8a5e81e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converting VIF {"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:fb,bridge_name='br-int',has_traffic_filtering=True,id=2d056b65-479a-43d0-96d1-9c53377bea9e,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d056b65-47') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.objects.instance [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:52:04 user nova-compute[73052]:   <uuid>8c5ecea5-aa8d-4743-9109-cab8a5e81e2d</uuid>
Aug 26 14:52:04 user nova-compute[73052]:   <name>instance-0000001a</name>
Aug 26 14:52:04 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:52:04 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:52:04 user nova-compute[73052]:   <metadata>
Aug 26 14:52:04 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:52:04 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:52:04 user nova-compute[73052]:       <nova:name>tempest-VolumesActionsTest-instance-607164700</nova:name>
Aug 26 14:52:04 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:52:04</nova:creationTime>
Aug 26 14:52:04 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:52:04 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:52:04 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:52:04 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:52:04 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:52:04 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:52:04 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:52:04 user nova-compute[73052]:       <nova:owner>
Aug 26 14:52:04 user nova-compute[73052]:         <nova:user uuid="ed5225f2064f43e893a054c3583a0b8f">tempest-VolumesActionsTest-1775568266-project-member</nova:user>
Aug 26 14:52:04 user nova-compute[73052]:         <nova:project uuid="3c1afa5dd9c74414a874e103410b71be">tempest-VolumesActionsTest-1775568266</nova:project>
Aug 26 14:52:04 user nova-compute[73052]:       </nova:owner>
Aug 26 14:52:04 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:52:04 user nova-compute[73052]:       <nova:ports>
Aug 26 14:52:04 user nova-compute[73052]:         <nova:port uuid="2d056b65-479a-43d0-96d1-9c53377bea9e">
Aug 26 14:52:04 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 14:52:04 user nova-compute[73052]:         </nova:port>
Aug 26 14:52:04 user nova-compute[73052]:       </nova:ports>
Aug 26 14:52:04 user nova-compute[73052]:     </nova:instance>
Aug 26 14:52:04 user nova-compute[73052]:   </metadata>
Aug 26 14:52:04 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:52:04 user nova-compute[73052]:     <system>
Aug 26 14:52:04 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:52:04 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:52:04 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:52:04 user nova-compute[73052]:       <entry name="serial">8c5ecea5-aa8d-4743-9109-cab8a5e81e2d</entry>
Aug 26 14:52:04 user nova-compute[73052]:       <entry name="uuid">8c5ecea5-aa8d-4743-9109-cab8a5e81e2d</entry>
Aug 26 14:52:04 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:52:04 user nova-compute[73052]:     </system>
Aug 26 14:52:04 user nova-compute[73052]:   </sysinfo>
Aug 26 14:52:04 user nova-compute[73052]:   <os>
Aug 26 14:52:04 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:52:04 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:52:04 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:52:04 user nova-compute[73052]:   </os>
Aug 26 14:52:04 user nova-compute[73052]:   <features>
Aug 26 14:52:04 user nova-compute[73052]:     <acpi/>
Aug 26 14:52:04 user nova-compute[73052]:     <apic/>
Aug 26 14:52:04 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:52:04 user nova-compute[73052]:   </features>
Aug 26 14:52:04 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:52:04 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:52:04 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:52:04 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:52:04 user nova-compute[73052]:   </clock>
Aug 26 14:52:04 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:52:04 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:52:04 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:52:04 user nova-compute[73052]:   </cpu>
Aug 26 14:52:04 user nova-compute[73052]:   <devices>
Aug 26 14:52:04 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:52:04 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:52:04 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk"/>
Aug 26 14:52:04 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:52:04 user nova-compute[73052]:     </disk>
Aug 26 14:52:04 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:52:04 user nova-compute[73052]:       <mac address="fa:16:3e:c3:19:fb"/>
Aug 26 14:52:04 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:52:04 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:52:04 user nova-compute[73052]:       <target dev="tap2d056b65-47"/>
Aug 26 14:52:04 user nova-compute[73052]:     </interface>
Aug 26 14:52:04 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:52:04 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/console.log" append="off"/>
Aug 26 14:52:04 user nova-compute[73052]:     </serial>
Aug 26 14:52:04 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:52:04 user nova-compute[73052]:     <video>
Aug 26 14:52:04 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:52:04 user nova-compute[73052]:     </video>
Aug 26 14:52:04 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:52:04 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:52:04 user nova-compute[73052]:     </rng>
Aug 26 14:52:04 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:52:04 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:52:04 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:52:04 user nova-compute[73052]:     </memballoon>
Aug 26 14:52:04 user nova-compute[73052]:   </devices>
Aug 26 14:52:04 user nova-compute[73052]: </domain>
Aug 26 14:52:04 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:51:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-607164700',display_name='tempest-VolumesActionsTest-instance-607164700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-607164700',id=26,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c1afa5dd9c74414a874e103410b71be',ramdisk_id='',reservation_id='r-rnl9fdkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775568266',owner_user_name='tempest-VolumesActionsTest-1775568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:01Z,user_data=None,user_id='ed5225f2064f43e893a054c3583a0b8f',uuid=8c5ecea5-aa8d-4743-9109-cab8a5e81e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converting VIF {"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:fb,bridge_name='br-int',has_traffic_filtering=True,id=2d056b65-479a-43d0-96d1-9c53377bea9e,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d056b65-47') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG os_vif [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:fb,bridge_name='br-int',has_traffic_filtering=True,id=2d056b65-479a-43d0-96d1-9c53377bea9e,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d056b65-47') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d056b65-47, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d056b65-47, col_values=(('external_ids', {'iface-id': '2d056b65-479a-43d0-96d1-9c53377bea9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:19:fb', 'vm-uuid': '8c5ecea5-aa8d-4743-9109-cab8a5e81e2d'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:04 user nova-compute[73052]: INFO os_vif [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:fb,bridge_name='br-int',has_traffic_filtering=True,id=2d056b65-479a-43d0-96d1-9c53377bea9e,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d056b65-47')
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] No VIF found with MAC fa:16:3e:c3:19:fb, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.network.neutron [req-02fa362b-adca-4ea0-a845-a9fe3e75fc0c req-dda1467b-26bc-4e95-95c1-2b42fc380248 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Updated VIF entry in instance network info cache for port 2d056b65-479a-43d0-96d1-9c53377bea9e. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG nova.network.neutron [req-02fa362b-adca-4ea0-a845-a9fe3e75fc0c req-dda1467b-26bc-4e95-95c1-2b42fc380248 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Updating instance_info_cache with network_info: [{"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-02fa362b-adca-4ea0-a845-a9fe3e75fc0c req-dda1467b-26bc-4e95-95c1-2b42fc380248 service nova] Releasing lock "refresh_cache-8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061527.9121692, 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] VM Resumed (Lifecycle Event)
Aug 26 14:52:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:52:07 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Instance spawned successfully.
Aug 26 14:52:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:08 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061527.9133317, 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:08 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] VM Started (Lifecycle Event)
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:52:08 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:52:08 user nova-compute[73052]: INFO nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Took 7.68 seconds to spawn the instance on the hypervisor.
Aug 26 14:52:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:08 user nova-compute[73052]: INFO nova.compute.manager [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Took 8.74 seconds to build instance.
Aug 26 14:52:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-02765a58-6924-464a-a112-c84a815faeeb tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.919s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-d997cdb4-102d-4ff8-b964-c211bab2ed82 req-2cf28c5e-ca20-4608-ae34-5d7bf2e69ed9 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received event network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d997cdb4-102d-4ff8-b964-c211bab2ed82 req-2cf28c5e-ca20-4608-ae34-5d7bf2e69ed9 service nova] Acquiring lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d997cdb4-102d-4ff8-b964-c211bab2ed82 req-2cf28c5e-ca20-4608-ae34-5d7bf2e69ed9 service nova] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d997cdb4-102d-4ff8-b964-c211bab2ed82 req-2cf28c5e-ca20-4608-ae34-5d7bf2e69ed9 service nova] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-d997cdb4-102d-4ff8-b964-c211bab2ed82 req-2cf28c5e-ca20-4608-ae34-5d7bf2e69ed9 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] No waiting events found dispatching network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:09 user nova-compute[73052]: WARNING nova.compute.manager [req-d997cdb4-102d-4ff8-b964-c211bab2ed82 req-2cf28c5e-ca20-4608-ae34-5d7bf2e69ed9 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received unexpected event network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e for instance with vm_state active and task_state None.
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-33a9c104-042c-4541-950f-40b940d6a52f req-7648ab04-d080-419c-b0d7-e25e8124b7ee service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received event network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-33a9c104-042c-4541-950f-40b940d6a52f req-7648ab04-d080-419c-b0d7-e25e8124b7ee service nova] Acquiring lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-33a9c104-042c-4541-950f-40b940d6a52f req-7648ab04-d080-419c-b0d7-e25e8124b7ee service nova] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-33a9c104-042c-4541-950f-40b940d6a52f req-7648ab04-d080-419c-b0d7-e25e8124b7ee service nova] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-33a9c104-042c-4541-950f-40b940d6a52f req-7648ab04-d080-419c-b0d7-e25e8124b7ee service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] No waiting events found dispatching network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:11 user nova-compute[73052]: WARNING nova.compute.manager [req-33a9c104-042c-4541-950f-40b940d6a52f req-7648ab04-d080-419c-b0d7-e25e8124b7ee service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received unexpected event network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e for instance with vm_state active and task_state None.
Aug 26 14:52:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:11 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:52:12 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:52:12 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7461MB free_disk=25.122196197509766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7e88d68a-33cf-467a-9e55-8162648a2b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7acb8d8e-f559-412c-91b3-e20f2df2a09a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:52:12 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:52:13 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:52:13 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:52:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:14 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061519.2233737, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:14 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Stopped (Lifecycle Event)
Aug 26 14:52:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c0da0d1-15d0-4532-bcf3-d7f15015e560 None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Starting finish_revert_migration {{(pid=73052) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Start _get_guest_xml network_info=[{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'cba50179-65a1-492a-8714-4315c39cee8c', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6', 'attached_at': '2023-08-26T14:52:15.000000', 'detached_at': '', 'volume_id': '5fe931b3-9a09-4e00-b36d-bbcf1b77e280', 'serial': '5fe931b3-9a09-4e00-b36d-bbcf1b77e280'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:52:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:52:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.objects.instance [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:52:15 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:52:15 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:52:15 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c68252-f0e8-4a40-8e09-3d62d77203ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:52:15 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2098d024-e1ba-483a-90cd-775587369a31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280] added
Aug 26 14:52:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2323bb21-2102-425f-b2a6-4a49c94d50c3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc088ce2-cada-469b-a231-0b30f3376e86]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfzBVdZX {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfzBVdZX" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7349b3e2-61f2-42ee-9a9c-937cf7a12369]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfzBVdZX'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[84349ad2-871b-48a9-b4b3-01eeff4e0cec]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cccacb0-34a6-49f5-8377-80acc0b4f22e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3974b73b-d6e4-4842-9ca4-cdd42be6a5ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]
Aug 26 14:52:15 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.
Aug 26 14:52:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[03560d08-44eb-4d49-9f84-5bd5137d1a45]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddece2dc-cf50-4f4c-b747-8a44c4339557]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:52:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[915250bb-7d82-462b-94e7-9a1f25860359]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:52:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23636366661643963', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636366661643963', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:52:16 user nova-compute[73052]:   <uuid>3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</uuid>
Aug 26 14:52:16 user nova-compute[73052]:   <name>instance-00000011</name>
Aug 26 14:52:16 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:52:16 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:52:16 user nova-compute[73052]:   <metadata>
Aug 26 14:52:16 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:52:16 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:52:16 user nova-compute[73052]:       <nova:name>tempest-ServerActionsTestOtherB-server-900953138</nova:name>
Aug 26 14:52:16 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:52:15</nova:creationTime>
Aug 26 14:52:16 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:52:16 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:52:16 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:52:16 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:52:16 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:52:16 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:52:16 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:52:16 user nova-compute[73052]:       <nova:owner>
Aug 26 14:52:16 user nova-compute[73052]:         <nova:user uuid="bb9db00a77d444f791cccb1be3d9150c">tempest-ServerActionsTestOtherB-135111462-project-member</nova:user>
Aug 26 14:52:16 user nova-compute[73052]:         <nova:project uuid="9dbc99e80f5340d0ab8b4c7fe2d0a0c1">tempest-ServerActionsTestOtherB-135111462</nova:project>
Aug 26 14:52:16 user nova-compute[73052]:       </nova:owner>
Aug 26 14:52:16 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:52:16 user nova-compute[73052]:       <nova:ports>
Aug 26 14:52:16 user nova-compute[73052]:         <nova:port uuid="fd15d9bd-b847-4224-8279-fa3bbb3958b9">
Aug 26 14:52:16 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 14:52:16 user nova-compute[73052]:         </nova:port>
Aug 26 14:52:16 user nova-compute[73052]:       </nova:ports>
Aug 26 14:52:16 user nova-compute[73052]:     </nova:instance>
Aug 26 14:52:16 user nova-compute[73052]:   </metadata>
Aug 26 14:52:16 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:52:16 user nova-compute[73052]:     <system>
Aug 26 14:52:16 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:52:16 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:52:16 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:52:16 user nova-compute[73052]:       <entry name="serial">3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</entry>
Aug 26 14:52:16 user nova-compute[73052]:       <entry name="uuid">3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6</entry>
Aug 26 14:52:16 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:52:16 user nova-compute[73052]:     </system>
Aug 26 14:52:16 user nova-compute[73052]:   </sysinfo>
Aug 26 14:52:16 user nova-compute[73052]:   <os>
Aug 26 14:52:16 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:52:16 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:52:16 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:52:16 user nova-compute[73052]:   </os>
Aug 26 14:52:16 user nova-compute[73052]:   <features>
Aug 26 14:52:16 user nova-compute[73052]:     <acpi/>
Aug 26 14:52:16 user nova-compute[73052]:     <apic/>
Aug 26 14:52:16 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:52:16 user nova-compute[73052]:   </features>
Aug 26 14:52:16 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:52:16 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:52:16 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:52:16 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:52:16 user nova-compute[73052]:   </clock>
Aug 26 14:52:16 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:52:16 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:52:16 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:52:16 user nova-compute[73052]:   </cpu>
Aug 26 14:52:16 user nova-compute[73052]:   <devices>
Aug 26 14:52:16 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:52:16 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:52:16 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk"/>
Aug 26 14:52:16 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:52:16 user nova-compute[73052]:     </disk>
Aug 26 14:52:16 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:52:16 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:52:16 user nova-compute[73052]:       <source dev="/dev/sdc"/>
Aug 26 14:52:16 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:52:16 user nova-compute[73052]:       <serial>5fe931b3-9a09-4e00-b36d-bbcf1b77e280</serial>
Aug 26 14:52:16 user nova-compute[73052]:     </disk>
Aug 26 14:52:16 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:52:16 user nova-compute[73052]:       <mac address="fa:16:3e:5d:9d:ed"/>
Aug 26 14:52:16 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:52:16 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:52:16 user nova-compute[73052]:       <target dev="tapfd15d9bd-b8"/>
Aug 26 14:52:16 user nova-compute[73052]:     </interface>
Aug 26 14:52:16 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:52:16 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/console.log" append="off"/>
Aug 26 14:52:16 user nova-compute[73052]:     </serial>
Aug 26 14:52:16 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:52:16 user nova-compute[73052]:     <video>
Aug 26 14:52:16 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:52:16 user nova-compute[73052]:     </video>
Aug 26 14:52:16 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:52:16 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:52:16 user nova-compute[73052]:     </rng>
Aug 26 14:52:16 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:52:16 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:52:16 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:52:16 user nova-compute[73052]:     </memballoon>
Aug 26 14:52:16 user nova-compute[73052]:   </devices>
Aug 26 14:52:16 user nova-compute[73052]: </domain>
Aug 26 14:52:16 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG os_vif [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd15d9bd-b8, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd15d9bd-b8, col_values=(('external_ids', {'iface-id': 'fd15d9bd-b847-4224-8279-fa3bbb3958b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:9d:ed', 'vm-uuid': '3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:52:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:16 user nova-compute[73052]: INFO os_vif [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8')
Aug 26 14:52:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-4542f5fe-d399-4fcf-bdd8-ff4c383c150f req-9c992763-5930-463d-99cf-d164cebdd8a9 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4542f5fe-d399-4fcf-bdd8-ff4c383c150f req-9c992763-5930-463d-99cf-d164cebdd8a9 service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4542f5fe-d399-4fcf-bdd8-ff4c383c150f req-9c992763-5930-463d-99cf-d164cebdd8a9 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4542f5fe-d399-4fcf-bdd8-ff4c383c150f req-9c992763-5930-463d-99cf-d164cebdd8a9 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-4542f5fe-d399-4fcf-bdd8-ff4c383c150f req-9c992763-5930-463d-99cf-d164cebdd8a9 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:18 user nova-compute[73052]: WARNING nova.compute.manager [req-4542f5fe-d399-4fcf-bdd8-ff4c383c150f req-9c992763-5930-463d-99cf-d164cebdd8a9 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state resized and task_state resize_reverting.
Aug 26 14:52:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061540.3635788, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Resumed (Lifecycle Event)
Aug 26 14:52:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance running successfully.
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] finish_revert_migration finished successfully. {{(pid=73052) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:52:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061540.3636856, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Started (Lifecycle Event)
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:52:20 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 14:52:20 user nova-compute[73052]: INFO nova.compute.manager [None req-35a146da-fad7-43b9-b4b6-e196c5f97d4e tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance to original state: 'active'
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-e91cd229-3ad9-42b8-bb11-cc13f2054364 req-4aab32a7-5c61-41da-add2-0c3c93e95e0a service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e91cd229-3ad9-42b8-bb11-cc13f2054364 req-4aab32a7-5c61-41da-add2-0c3c93e95e0a service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e91cd229-3ad9-42b8-bb11-cc13f2054364 req-4aab32a7-5c61-41da-add2-0c3c93e95e0a service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e91cd229-3ad9-42b8-bb11-cc13f2054364 req-4aab32a7-5c61-41da-add2-0c3c93e95e0a service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-e91cd229-3ad9-42b8-bb11-cc13f2054364 req-4aab32a7-5c61-41da-add2-0c3c93e95e0a service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:20 user nova-compute[73052]: WARNING nova.compute.manager [req-e91cd229-3ad9-42b8-bb11-cc13f2054364 req-4aab32a7-5c61-41da-add2-0c3c93e95e0a service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state resized and task_state resize_reverting.
Aug 26 14:52:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:52:33 user nova-compute[73052]: INFO nova.compute.claims [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Claim successful on node user
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:52:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:52:33 user nova-compute[73052]: INFO nova.virt.block_device [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Booting with volume 5b421b39-c751-436e-98ad-a20e76ad2ccf at /dev/vda
Aug 26 14:52:33 user nova-compute[73052]: DEBUG os_brick.utils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1433f5d-93a2-4106-ac69-49c9c73762bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1d2554-1550-4555-9588-9d71ffdf98ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f9462-b439-4fd6-8d50-f65f06059e9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f2aae0-a931-4414-813d-7763be4cf34e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.policy [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6587b43004af49e8bafcfbbd9cd216f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca20bab8a7f946889bb2be94209c3c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:52:33 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:52:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8954fc17-f435-4268-baca-6fa544d89796]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG os_brick.utils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:52:33 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating existing volume attachment record: 446ce927-8e3c-477b-9974-3c05d2d80d87 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:52:34 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully created port: fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:52:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully created port: 93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:52:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully created port: 115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:52:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully created port: 69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:52:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully created port: 6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:52:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:52:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:37 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:52:37 user nova-compute[73052]: INFO nova.compute.claims [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Claim successful on node user
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully updated port: fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-546d7f54-4e24-4a55-836c-289f75337400 req-63737c85-7bde-4e55-8855-bf7b4263cd2a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-changed-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-546d7f54-4e24-4a55-836c-289f75337400 req-63737c85-7bde-4e55-8855-bf7b4263cd2a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing instance network info cache due to event network-changed-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-546d7f54-4e24-4a55-836c-289f75337400 req-63737c85-7bde-4e55-8855-bf7b4263cd2a service nova] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-546d7f54-4e24-4a55-836c-289f75337400 req-63737c85-7bde-4e55-8855-bf7b4263cd2a service nova] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.network.neutron [req-546d7f54-4e24-4a55-836c-289f75337400 req-63737c85-7bde-4e55-8855-bf7b4263cd2a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing network info cache for port fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:38 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.policy [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5477383284f46df97949c64f6cc0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7454d6d00cc4165b90d29aeea11067b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.network.neutron [req-546d7f54-4e24-4a55-836c-289f75337400 req-63737c85-7bde-4e55-8855-bf7b4263cd2a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:52:38 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Creating image(s)
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "/opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "/opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "/opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "7c88ea8d9f9d310fd3b2d723ff9227db2131837c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "7c88ea8d9f9d310fd3b2d723ff9227db2131837c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Successfully created port: 3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c.part --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.virt.images [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] 9b70267c-3338-42a0-9017-bc3de23f25d1 was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c.part /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-546d7f54-4e24-4a55-836c-289f75337400 req-63737c85-7bde-4e55-8855-bf7b4263cd2a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-546d7f54-4e24-4a55-836c-289f75337400 req-63737c85-7bde-4e55-8855-bf7b4263cd2a service nova] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c.part /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c.converted" returned: 0 in 0.381s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully updated port: ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "7c88ea8d9f9d310fd3b2d723ff9227db2131837c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.400s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Successfully updated port: 3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "7c88ea8d9f9d310fd3b2d723ff9227db2131837c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "7c88ea8d9f9d310fd3b2d723ff9227db2131837c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-dabcc9fc-ff92-40c1-aae7-d46031ae6036 req-8602cde5-fb04-41b8-bb6c-ed1bf714488d service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-dabcc9fc-ff92-40c1-aae7-d46031ae6036 req-8602cde5-fb04-41b8-bb6c-ed1bf714488d service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing instance network info cache due to event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dabcc9fc-ff92-40c1-aae7-d46031ae6036 req-8602cde5-fb04-41b8-bb6c-ed1bf714488d service nova] Acquiring lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dabcc9fc-ff92-40c1-aae7-d46031ae6036 req-8602cde5-fb04-41b8-bb6c-ed1bf714488d service nova] Acquired lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-dabcc9fc-ff92-40c1-aae7-d46031ae6036 req-8602cde5-fb04-41b8-bb6c-ed1bf714488d service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-dabcc9fc-ff92-40c1-aae7-d46031ae6036 req-8602cde5-fb04-41b8-bb6c-ed1bf714488d service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c --force-share --output=json" returned: 0 in 0.198s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c,backing_fmt=raw /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c,backing_fmt=raw /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk 1073741824" returned: 0 in 0.056s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "7c88ea8d9f9d310fd3b2d723ff9227db2131837c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-e3df32de-7df2-4e13-b7b4-18149b1f8baf req-2759a560-c28a-4a77-a67c-1c48fff5c0b3 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-changed-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-e3df32de-7df2-4e13-b7b4-18149b1f8baf req-2759a560-c28a-4a77-a67c-1c48fff5c0b3 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing instance network info cache due to event network-changed-ed152f00-04c7-4852-a2b8-e0e94a6e94ff. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e3df32de-7df2-4e13-b7b4-18149b1f8baf req-2759a560-c28a-4a77-a67c-1c48fff5c0b3 service nova] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e3df32de-7df2-4e13-b7b4-18149b1f8baf req-2759a560-c28a-4a77-a67c-1c48fff5c0b3 service nova] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-e3df32de-7df2-4e13-b7b4-18149b1f8baf req-2759a560-c28a-4a77-a67c-1c48fff5c0b3 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing network info cache for port ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-e3df32de-7df2-4e13-b7b4-18149b1f8baf req-2759a560-c28a-4a77-a67c-1c48fff5c0b3 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully updated port: a4827275-1e85-4b0f-a824-386860a5de8e {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Cannot resize image /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Ensure instance console log exists: /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-e3df32de-7df2-4e13-b7b4-18149b1f8baf req-2759a560-c28a-4a77-a67c-1c48fff5c0b3 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e3df32de-7df2-4e13-b7b4-18149b1f8baf req-2759a560-c28a-4a77-a67c-1c48fff5c0b3 service nova] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-dabcc9fc-ff92-40c1-aae7-d46031ae6036 req-8602cde5-fb04-41b8-bb6c-ed1bf714488d service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dabcc9fc-ff92-40c1-aae7-d46031ae6036 req-8602cde5-fb04-41b8-bb6c-ed1bf714488d service nova] Releasing lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquired lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:40 user nova-compute[73052]: INFO nova.compute.manager [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Terminating instance
Aug 26 14:52:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating instance_info_cache with network_info: [{"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Releasing lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance network_info: |[{"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Start _get_guest_xml network_info=[{"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:52:34Z,direct_url=<?>,disk_format='qcow2',id=9b70267c-3338-42a0-9017-bc3de23f25d1,min_disk=0,min_ram=0,name='tempest-scenario-img--1068690246',owner='a7454d6d00cc4165b90d29aeea11067b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:52:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '9b70267c-3338-42a0-9017-bc3de23f25d1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:52:41 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:52:41 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:52:34Z,direct_url=<?>,disk_format='qcow2',id=9b70267c-3338-42a0-9017-bc3de23f25d1,min_disk=0,min_ram=0,name='tempest-scenario-img--1068690246',owner='a7454d6d00cc4165b90d29aeea11067b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:52:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-40607858',display_name='tempest-TestMinimumBasicScenario-server-40607858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-40607858',id=28,image_ref='9b70267c-3338-42a0-9017-bc3de23f25d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0DFrLcI+1d0Nt4ub5zsk8f2QHPukBYSTOYI/xQk/oNL+lfo/7i+kft7UHe2b8HK2rHrbKUPoRTkRaQzwoLAbY11jn27IxE1hJ5EKM2gnqu/if5EckzgGfJB8bMZ36hWw==',key_name='tempest-TestMinimumBasicScenario-1581449756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-1a8i8qhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b70267c-3338-42a0-9017-bc3de23f25d1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:38Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=de3630fa-98b3-4a5a-b008-e98f0c72d0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:a9:f3,bridge_name='br-int',has_traffic_filtering=True,id=3fc35180-bc12-4f46-a612-6d51786c0780,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc35180-bc') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'pci_devices' on Instance uuid de3630fa-98b3-4a5a-b008-e98f0c72d0ea {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:52:41 user nova-compute[73052]:   <uuid>de3630fa-98b3-4a5a-b008-e98f0c72d0ea</uuid>
Aug 26 14:52:41 user nova-compute[73052]:   <name>instance-0000001c</name>
Aug 26 14:52:41 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:52:41 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:52:41 user nova-compute[73052]:   <metadata>
Aug 26 14:52:41 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:52:41 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:52:41 user nova-compute[73052]:       <nova:name>tempest-TestMinimumBasicScenario-server-40607858</nova:name>
Aug 26 14:52:41 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:52:41</nova:creationTime>
Aug 26 14:52:41 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:52:41 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:52:41 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:52:41 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:52:41 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:52:41 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:52:41 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:52:41 user nova-compute[73052]:       <nova:owner>
Aug 26 14:52:41 user nova-compute[73052]:         <nova:user uuid="c5477383284f46df97949c64f6cc0021">tempest-TestMinimumBasicScenario-1910985391-project-member</nova:user>
Aug 26 14:52:41 user nova-compute[73052]:         <nova:project uuid="a7454d6d00cc4165b90d29aeea11067b">tempest-TestMinimumBasicScenario-1910985391</nova:project>
Aug 26 14:52:41 user nova-compute[73052]:       </nova:owner>
Aug 26 14:52:41 user nova-compute[73052]:       <nova:root type="image" uuid="9b70267c-3338-42a0-9017-bc3de23f25d1"/>
Aug 26 14:52:41 user nova-compute[73052]:       <nova:ports>
Aug 26 14:52:41 user nova-compute[73052]:         <nova:port uuid="3fc35180-bc12-4f46-a612-6d51786c0780">
Aug 26 14:52:41 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 14:52:41 user nova-compute[73052]:         </nova:port>
Aug 26 14:52:41 user nova-compute[73052]:       </nova:ports>
Aug 26 14:52:41 user nova-compute[73052]:     </nova:instance>
Aug 26 14:52:41 user nova-compute[73052]:   </metadata>
Aug 26 14:52:41 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:52:41 user nova-compute[73052]:     <system>
Aug 26 14:52:41 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:52:41 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:52:41 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:52:41 user nova-compute[73052]:       <entry name="serial">de3630fa-98b3-4a5a-b008-e98f0c72d0ea</entry>
Aug 26 14:52:41 user nova-compute[73052]:       <entry name="uuid">de3630fa-98b3-4a5a-b008-e98f0c72d0ea</entry>
Aug 26 14:52:41 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:52:41 user nova-compute[73052]:     </system>
Aug 26 14:52:41 user nova-compute[73052]:   </sysinfo>
Aug 26 14:52:41 user nova-compute[73052]:   <os>
Aug 26 14:52:41 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:52:41 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:52:41 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:52:41 user nova-compute[73052]:   </os>
Aug 26 14:52:41 user nova-compute[73052]:   <features>
Aug 26 14:52:41 user nova-compute[73052]:     <acpi/>
Aug 26 14:52:41 user nova-compute[73052]:     <apic/>
Aug 26 14:52:41 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:52:41 user nova-compute[73052]:   </features>
Aug 26 14:52:41 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:52:41 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:52:41 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:52:41 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:52:41 user nova-compute[73052]:   </clock>
Aug 26 14:52:41 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:52:41 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:52:41 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:52:41 user nova-compute[73052]:   </cpu>
Aug 26 14:52:41 user nova-compute[73052]:   <devices>
Aug 26 14:52:41 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:52:41 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:52:41 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk"/>
Aug 26 14:52:41 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:52:41 user nova-compute[73052]:     </disk>
Aug 26 14:52:41 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:52:41 user nova-compute[73052]:       <mac address="fa:16:3e:41:a9:f3"/>
Aug 26 14:52:41 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:52:41 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:52:41 user nova-compute[73052]:       <target dev="tap3fc35180-bc"/>
Aug 26 14:52:41 user nova-compute[73052]:     </interface>
Aug 26 14:52:41 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:52:41 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/console.log" append="off"/>
Aug 26 14:52:41 user nova-compute[73052]:     </serial>
Aug 26 14:52:41 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:52:41 user nova-compute[73052]:     <video>
Aug 26 14:52:41 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:52:41 user nova-compute[73052]:     </video>
Aug 26 14:52:41 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:52:41 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:52:41 user nova-compute[73052]:     </rng>
Aug 26 14:52:41 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:52:41 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:52:41 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:52:41 user nova-compute[73052]:     </memballoon>
Aug 26 14:52:41 user nova-compute[73052]:   </devices>
Aug 26 14:52:41 user nova-compute[73052]: </domain>
Aug 26 14:52:41 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-40607858',display_name='tempest-TestMinimumBasicScenario-server-40607858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-40607858',id=28,image_ref='9b70267c-3338-42a0-9017-bc3de23f25d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0DFrLcI+1d0Nt4ub5zsk8f2QHPukBYSTOYI/xQk/oNL+lfo/7i+kft7UHe2b8HK2rHrbKUPoRTkRaQzwoLAbY11jn27IxE1hJ5EKM2gnqu/if5EckzgGfJB8bMZ36hWw==',key_name='tempest-TestMinimumBasicScenario-1581449756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-1a8i8qhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b70267c-3338-42a0-9017-bc3de23f25d1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:38Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=de3630fa-98b3-4a5a-b008-e98f0c72d0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:a9:f3,bridge_name='br-int',has_traffic_filtering=True,id=3fc35180-bc12-4f46-a612-6d51786c0780,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc35180-bc') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG os_vif [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:a9:f3,bridge_name='br-int',has_traffic_filtering=True,id=3fc35180-bc12-4f46-a612-6d51786c0780,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc35180-bc') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fc35180-bc, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fc35180-bc, col_values=(('external_ids', {'iface-id': '3fc35180-bc12-4f46-a612-6d51786c0780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:a9:f3', 'vm-uuid': 'de3630fa-98b3-4a5a-b008-e98f0c72d0ea'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: INFO os_vif [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:a9:f3,bridge_name='br-int',has_traffic_filtering=True,id=3fc35180-bc12-4f46-a612-6d51786c0780,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc35180-bc')
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No VIF found with MAC fa:16:3e:41:a9:f3, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:52:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Instance destroyed successfully.
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lazy-loading 'resources' on Instance uuid 7e88d68a-33cf-467a-9e55-8162648a2b02 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1978096229',display_name='tempest-ServerStableDeviceRescueTest-server-1978096229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1978096229',id=16,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYl6zJKbt43Fyr9FOe8j13+xH2QHq8Iaym6cf5iO5DFrk/ua4JwD+Mi7UoN3tw1MVSdsO76B0Oh178aC7MsQRIg3HANtZM5pUTjd26VfvXyzWyzzNYuZOnjhaOuN+Cww==',key_name='tempest-keypair-1722362',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4564e9f65a9e4608a95bae156d64d4b0',ramdisk_id='',reservation_id='r-cfdfmddr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-848131570',owner_user_name='tempest-ServerStableDeviceRescueTest-848131570-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f7c01b6be324d92bdb021b34d2c011b',uuid=7e88d68a-33cf-467a-9e55-8162648a2b02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Converting VIF {"id": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "address": "fa:16:3e:c1:d7:cd", "network": {"id": "d9ac1582-5175-4ca3-9ce2-0cc6451c5f24", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-226212371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4564e9f65a9e4608a95bae156d64d4b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c81e0c-e3", "ovs_interfaceid": "d5c81e0c-e3d2-42e3-a444-a1730b6d4763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763,network=Network(d9ac1582-5175-4ca3-9ce2-0cc6451c5f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c81e0c-e3') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG os_vif [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763,network=Network(d9ac1582-5175-4ca3-9ce2-0cc6451c5f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c81e0c-e3') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5c81e0c-e3, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:52:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:41 user nova-compute[73052]: INFO os_vif [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763,network=Network(d9ac1582-5175-4ca3-9ce2-0cc6451c5f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c81e0c-e3')
Aug 26 14:52:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Deleting instance files /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02_del
Aug 26 14:52:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Deletion of /opt/stack/data/nova/instances/7e88d68a-33cf-467a-9e55-8162648a2b02_del complete
Aug 26 14:52:42 user nova-compute[73052]: INFO nova.compute.manager [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 14:52:42 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:52:42 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:52:42 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:52:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-changed-a4827275-1e85-4b0f-a824-386860a5de8e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing instance network info cache due to event network-changed-a4827275-1e85-4b0f-a824-386860a5de8e. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing network info cache for port a4827275-1e85-4b0f-a824-386860a5de8e {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully updated port: 93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-356c1676-b70b-4666-9ac2-a0be33c01bc4 req-dc987a05-8fa6-4e01-a571-c6dc30fea2d2 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-unplugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-883e971d-0d88-44b1-a73a-1170904875bf req-b443f2c1-2ca8-4e67-bf70-5596bfbce9c0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-deleted-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:43 user nova-compute[73052]: INFO nova.compute.manager [req-883e971d-0d88-44b1-a73a-1170904875bf req-b443f2c1-2ca8-4e67-bf70-5596bfbce9c0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Neutron deleted interface d5c81e0c-e3d2-42e3-a444-a1730b6d4763; detaching it from the instance and deleting it from the info cache
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-883e971d-0d88-44b1-a73a-1170904875bf req-b443f2c1-2ca8-4e67-bf70-5596bfbce9c0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:43 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Took 1.00 seconds to deallocate network for instance.
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-883e971d-0d88-44b1-a73a-1170904875bf req-b443f2c1-2ca8-4e67-bf70-5596bfbce9c0 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Detach interface failed, port_id=d5c81e0c-e3d2-42e3-a444-a1730b6d4763, reason: Instance 7e88d68a-33cf-467a-9e55-8162648a2b02 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:43 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.753s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:44 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Deleted allocations for instance 7e88d68a-33cf-467a-9e55-8162648a2b02
Aug 26 14:52:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-633c1638-0ca1-4676-9db6-75f37d519a9f tempest-ServerStableDeviceRescueTest-848131570 tempest-ServerStableDeviceRescueTest-848131570-project-member] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.221s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully updated port: 115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] Acquiring lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] Lock "7e88d68a-33cf-467a-9e55-8162648a2b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] No waiting events found dispatching network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:44 user nova-compute[73052]: WARNING nova.compute.manager [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Received unexpected event network-vif-plugged-d5c81e0c-e3d2-42e3-a444-a1730b6d4763 for instance with vm_state deleted and task_state None.
Aug 26 14:52:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-changed-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing instance network info cache due to event network-changed-93f8f206-6c7b-4e89-9172-363eb5dca4db. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG nova.network.neutron [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing network info cache for port 93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG nova.network.neutron [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG nova.network.neutron [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5bbe4326-4841-4002-bc57-c75215204050 req-7a94c6f6-7905-476f-b1c7-fdb0c0180a61 service nova] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] No waiting events found dispatching network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:45 user nova-compute[73052]: WARNING nova.compute.manager [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received unexpected event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 for instance with vm_state building and task_state spawning.
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] No waiting events found dispatching network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:45 user nova-compute[73052]: WARNING nova.compute.manager [req-69534340-d282-4721-9660-8b8b1f2e4fb5 req-dcbbf33d-9688-411f-8df8-adf613525e22 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received unexpected event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 for instance with vm_state building and task_state spawning.
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully updated port: 69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061565.9165645, de3630fa-98b3-4a5a-b008-e98f0c72d0ea => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] VM Resumed (Lifecycle Event)
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:52:45 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance spawned successfully.
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:52:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:52:45 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061565.9195058, de3630fa-98b3-4a5a-b008-e98f0c72d0ea => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] VM Started (Lifecycle Event)
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:52:46 user nova-compute[73052]: INFO nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Took 7.69 seconds to spawn the instance on the hypervisor.
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:52:46 user nova-compute[73052]: INFO nova.compute.manager [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Took 8.56 seconds to build instance.
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Successfully updated port: 6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b8fcf306-09e8-468d-a04f-b7d5f1ec50ed tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.673s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:52:46 user nova-compute[73052]: INFO nova.virt.block_device [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Booting with volume ee5347c5-fa97-45fa-9c9f-59da2afc1736 at /dev/vdb
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-changed-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing instance network info cache due to event network-changed-115baf9d-2558-4071-8b4c-71b1c34b9f35. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG os_brick.utils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c9eb1a-120b-496a-868a-7ee67fbb80b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d306c1-346d-4154-a323-e78e6bcb70e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1335b7-36d1-400a-b838-5749c1e97d2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[436f1c3a-750e-4ec1-9810-bbd752ad1062]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:52:46 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f58fc1-88f9-4e92-9f32-ad4b1f1d7a84]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG os_brick.utils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating existing volume attachment record: 6ed2c2b4-c4f8-4ed8-a52e-16f8ae958035 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:52:46 user nova-compute[73052]: INFO nova.compute.manager [None req-71080ae4-711b-4d58-b185-d4f9640406ba tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Unrescuing
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-71080ae4-711b-4d58-b185-d4f9640406ba tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-71080ae4-711b-4d58-b185-d4f9640406ba tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquired lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG nova.network.neutron [None req-71080ae4-711b-4d58-b185-d4f9640406ba tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:52:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-71080ae4-711b-4d58-b185-d4f9640406ba tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-71080ae4-711b-4d58-b185-d4f9640406ba tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Releasing lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG nova.objects.instance [None req-71080ae4-711b-4d58-b185-d4f9640406ba tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'flavor' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-5a330ffc-8e84-4887-b497-6a076204006e req-3bc96261-592a-4266-9f0d-8f65823904e3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5a330ffc-8e84-4887-b497-6a076204006e req-3bc96261-592a-4266-9f0d-8f65823904e3 service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5a330ffc-8e84-4887-b497-6a076204006e req-3bc96261-592a-4266-9f0d-8f65823904e3 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5a330ffc-8e84-4887-b497-6a076204006e req-3bc96261-592a-4266-9f0d-8f65823904e3 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-5a330ffc-8e84-4887-b497-6a076204006e req-3bc96261-592a-4266-9f0d-8f65823904e3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:47 user nova-compute[73052]: WARNING nova.compute.manager [req-5a330ffc-8e84-4887-b497-6a076204006e req-3bc96261-592a-4266-9f0d-8f65823904e3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:52:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance destroyed successfully.
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance network_info: |[{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing network info cache for port 115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-0cb5afbe-20aa-4b2c-b04f-186cb64d7f0a req-446f1d7f-276a-4175-98c1-abec6cdb8775 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0cb5afbe-20aa-4b2c-b04f-186cb64d7f0a req-446f1d7f-276a-4175-98c1-abec6cdb8775 service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0cb5afbe-20aa-4b2c-b04f-186cb64d7f0a req-446f1d7f-276a-4175-98c1-abec6cdb8775 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0cb5afbe-20aa-4b2c-b04f-186cb64d7f0a req-446f1d7f-276a-4175-98c1-abec6cdb8775 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-0cb5afbe-20aa-4b2c-b04f-186cb64d7f0a req-446f1d7f-276a-4175-98c1-abec6cdb8775 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:49 user nova-compute[73052]: WARNING nova.compute.manager [req-0cb5afbe-20aa-4b2c-b04f-186cb64d7f0a req-446f1d7f-276a-4175-98c1-abec6cdb8775 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updated VIF entry in instance network info cache for port 115baf9d-2558-4071-8b4c-71b1c34b9f35. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-changed-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing instance network info cache due to event network-changed-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing network info cache for port 69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updated VIF entry in instance network info cache for port 69f52b6e-1f9b-4cc6-86d8-37a326ca0a58. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-changed-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing instance network info cache due to event network-changed-6c091ed1-30d3-4b40-985f-2db76f7b8862. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing network info cache for port 6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updated VIF entry in instance network info cache for port 6c091ed1-30d3-4b40-985f-2db76f7b8862. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG nova.network.neutron [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:52:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-037d1fd6-8ffb-4bfa-90a0-9add49c90ef0 req-e9c64209-455d-42a4-950e-99c8a113b6bf service nova] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:51 user nova-compute[73052]: WARNING nova.compute.manager [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:52:51 user nova-compute[73052]: WARNING nova.compute.manager [req-9249c8e4-88c8-4c5f-a931-258134f87f7d req-f4af0200-fe99-43f4-8e15-63ab0689c8f3 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state rescued and task_state unrescuing.
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for 2b3a3e44-b6be-4d68-b034-843d74ba9334 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061571.8951123, 2b3a3e44-b6be-4d68-b034-843d74ba9334 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:51 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] VM Resumed (Lifecycle Event)
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-71080ae4-711b-4d58-b185-d4f9640406ba tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:52:51 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061571.899021, 2b3a3e44-b6be-4d68-b034-843d74ba9334 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:51 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] VM Started (Lifecycle Event)
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:52:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:52:56 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061561.9439466, 7e88d68a-33cf-467a-9e55-8162648a2b02 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:52:56 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] VM Stopped (Lifecycle Event)
Aug 26 14:52:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-a12cef55-c608-454a-87ad-b3fed5094e2f None None] [instance: 7e88d68a-33cf-467a-9e55-8162648a2b02] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:52:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:52:59 user nova-compute[73052]: INFO nova.virt.block_device [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Booting with volume f9726a27-13f2-44e8-8d48-ea28449e4444 at /dev/vdc
Aug 26 14:52:59 user nova-compute[73052]: DEBUG os_brick.utils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da0d40-e489-41f1-a490-17673f875d92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d5f1f2-cb67-4ac6-8d77-5c76b8ca7e79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd90e84-b8a0-4906-ba6d-df5be55d0f31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d46087f-93e3-4166-9377-86efbbd650ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:52:59 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44abf3b-c544-48ba-b2f1-465a1e84b4e7]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG os_brick.utils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating existing volume attachment record: 5546ae4c-ea6a-4db0-adfe-8bd074ddc58e {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:52:59 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:53:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating instance_info_cache with network_info: [{"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-92558f0f-dc80-4acf-b3b9-27d0244c0ddb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:53:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:53:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:53:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:53:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:53:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:53:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:53:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:53:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:09 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:53:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:09 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:53:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Creating image(s)
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Ensure instance console log exists: /opt/stack/data/nova/instances/4a1dd457-797c-45b6-bc73-c6c5276acacb/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Start _get_guest_xml network_info=[{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '446ce927-8e3c-477b-9974-3c05d2d80d87', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxVAiwPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a1dd457-797c-45b6-bc73-c6c5276acacb', 'attached_at': '', 'detached_at': '', 'volume_id': '5b421b39-c751-436e-98ad-a20e76ad2ccf', 'serial': '5b421b39-c751-436e-98ad-a20e76ad2ccf'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '6ed2c2b4-c4f8-4ed8-a52e-16f8ae958035', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKkWUuvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a1dd457-797c-45b6-bc73-c6c5276acacb', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee5347c5-fa97-45fa-9c9f-59da2afc1736', 'serial': 'ee5347c5-fa97-45fa-9c9f-59da2afc1736'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '5546ae4c-ea6a-4db0-adfe-8bd074ddc58e', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lerLHDRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a1dd457-797c-45b6-bc73-c6c5276acacb', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9726a27-13f2-44e8-8d48-ea28449e4444', 'serial': 'f9726a27-13f2-44e8-8d48-ea28449e4444'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:53:12 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:53:12 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxVAiwPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:53:12 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:53:12 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:53:12 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[402941bd-c71f-4d48-80ab-1573c54faad5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:53:12 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f60aae-f52a-445b-94cc-da9277163117]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf] added
Aug 26 14:53:12 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[34765e11-b3f8-4f1b-8955-27d4b6c5c53e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e187a4b8-0003-4e05-9777-ae08e7504bdb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxVAiwPn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxVAiwPn" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[28486e64-8abb-449c-b3ba-e9cd77dfdef0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yxVAiwPn'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfa6432-575b-4a83-b182-21a34062dc0e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9765717-b48d-47e9-8ffb-2ff1311854fc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:12 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:12 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:12 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:12 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:12 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:12 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --login" returned: 0 in 1.093s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0411b6b7-3224-4568-ba5b-49812853b461]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf, portal: 172.16.0.220,3260]
Aug 26 14:53:13 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf, portal: 172.16.0.220,3260] successful.
Aug 26 14:53:13 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45e84e2-f378-4313-a93a-92f2bbb902d2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f2770e-2a50-46fa-937b-db3cc4e949cf]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:13 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:13 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:13 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:13 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:13 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:13 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:13 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:13 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.444s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[315b48d1-5ad8-4b2d-be57-6911b6a259ab]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:13 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:14 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:53:14 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7224MB free_disk=25.193984985351562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7acb8d8e-f559-412c-91b3-e20f2df2a09a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4a1dd457-797c-45b6-bc73-c6c5276acacb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxVAiwPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.485s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== connect_volume: return (2486ms) {'type': 'block', 'scsi_wwn': '26461373166306538', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461373166306538', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKkWUuvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:53:14 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:53:14 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:53:14 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:53:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c97142d-433a-40c3-a4f3-8370164cf5df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:14 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:53:14 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc573d-9736-4c54-aeab-718643f7b9e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736] added
Aug 26 14:53:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[09665883-a299-4706-86e2-c0d521c7a57f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be147c8-2751-4f97-9d1f-97f811fc6e54]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKkWUuvf {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKkWUuvf" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[240b58e6-f05a-4ee8-8697-42279f3043cb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lKkWUuvf'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bdf714-4996-4030-a7a0-95b6c39aef71]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b53d1c-b031-4400-9e97-e89d2db79a2c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0a4dd6-e390-4f16-a8ae-592a3eac3e44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736, portal: 172.16.0.220,3260]
Aug 26 14:53:15 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736, portal: 172.16.0.220,3260] successful.
Aug 26 14:53:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[56655875-d723-4031-872e-0a2d3ce557c1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6138a2d4-276a-4f1e-8a1d-ee722a33b111]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:15 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:15 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f348dccc-95e0-472a-9482-64a1ec3575f2]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:53:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKkWUuvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26331643663663762', 'path': '/dev/sdf'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331643663663762', 'path': '/dev/sdf'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:53:16 user nova-compute[73052]: INFO nova.compute.claims [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Claim successful on node user
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lerLHDRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:53:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:53:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:53:16 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[344bcb25-6c46-4f79-9533-d2981a32eccd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:53:16 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9875a3-6fb7-48bf-b112-35cda8ee5a7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444] added
Aug 26 14:53:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314e8e9-b00e-40a7-855b-3db8cb43d8e8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[85afa970-f811-4138-bdc2-0b872b388497]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lerLHDRq {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lerLHDRq" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b44d4b4-f2e1-4720-8541-19cbc6f57dab]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lerLHDRq'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[47feec35-b7f8-4b54-9d6a-18fa2f291fe2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d517f5d-cf17-4d86-b9ce-e61ac3158535]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[639e13d5-7b4e-4cd4-802a-c33ea3300050]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444, portal: 172.16.0.220,3260]
Aug 26 14:53:16 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444, portal: 172.16.0.220,3260] successful.
Aug 26 14:53:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c757765-1c04-48a8-a815-6280e0c9ca6b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e566249f-a6b0-4537-b174-71629d2e5bf8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:53:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21fcd5-4675-4ec2-8853-6a30ca1f68ac]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lerLHDRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:53:16 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:53:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:53:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.policy [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5061033588974e7ead6c7abc8a47308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3fc9a170804f0ebfa2dde967e3fec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:53:17 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Creating image(s)
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.206s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk 1073741824" returned: 0 in 0.052s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Successfully created port: 770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26231373334303466', 'path': '/dev/sdg'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231373334303466', 'path': '/dev/sdg'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:eb:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f,network=Network(12509040-b05f-4317-acb8-e6b7b6cbb001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb9c0fc-c9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ab:47,bridge_name='br-int',has_traffic_filtering=True,id=ed152f00-04c7-4852-a2b8-e0e94a6e94ff,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped152f00-04') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5d:09,bridge_name='br-int',has_traffic_filtering=True,id=a4827275-1e85-4b0f-a824-386860a5de8e,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4827275-1e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:5e,bridge_name='br-int',has_traffic_filtering=True,id=93f8f206-6c7b-4e89-9172-363eb5dca4db,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8f206-6c') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=115baf9d-2558-4071-8b4c-71b1c34b9f35,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115baf9d-25') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:99:2d,bridge_name='br-int',has_traffic_filtering=True,id=69f52b6e-1f9b-4cc6-86d8-37a326ca0a58,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f52b6e-1f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b8:0e,bridge_name='br-int',has_traffic_filtering=True,id=6c091ed1-30d3-4b40-985f-2db76f7b8862,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c091ed1-30') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a1dd457-797c-45b6-bc73-c6c5276acacb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:53:17 user nova-compute[73052]:   <uuid>4a1dd457-797c-45b6-bc73-c6c5276acacb</uuid>
Aug 26 14:53:17 user nova-compute[73052]:   <name>instance-0000001b</name>
Aug 26 14:53:17 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:53:17 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:53:17 user nova-compute[73052]:   <metadata>
Aug 26 14:53:17 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:53:17 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:53:17 user nova-compute[73052]:       <nova:name>tempest-device-tagging-server-1890719496</nova:name>
Aug 26 14:53:17 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:53:12</nova:creationTime>
Aug 26 14:53:17 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:53:17 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:53:17 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:53:17 user nova-compute[73052]:       <nova:owner>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:user uuid="6587b43004af49e8bafcfbbd9cd216f7">tempest-TaggedBootDevicesTest-1108680602-project-member</nova:user>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:project uuid="ca20bab8a7f946889bb2be94209c3c39">tempest-TaggedBootDevicesTest-1108680602</nova:project>
Aug 26 14:53:17 user nova-compute[73052]:       </nova:owner>
Aug 26 14:53:17 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:53:17 user nova-compute[73052]:       <nova:ports>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:port uuid="fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f">
Aug 26 14:53:17 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 14:53:17 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:port uuid="ed152f00-04c7-4852-a2b8-e0e94a6e94ff">
Aug 26 14:53:17 user nova-compute[73052]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Aug 26 14:53:17 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:port uuid="a4827275-1e85-4b0f-a824-386860a5de8e">
Aug 26 14:53:17 user nova-compute[73052]:           <nova:ip type="fixed" address="10.1.1.114" ipVersion="4"/>
Aug 26 14:53:17 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:port uuid="93f8f206-6c7b-4e89-9172-363eb5dca4db">
Aug 26 14:53:17 user nova-compute[73052]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Aug 26 14:53:17 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:port uuid="115baf9d-2558-4071-8b4c-71b1c34b9f35">
Aug 26 14:53:17 user nova-compute[73052]:           <nova:ip type="fixed" address="10.1.1.31" ipVersion="4"/>
Aug 26 14:53:17 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:port uuid="69f52b6e-1f9b-4cc6-86d8-37a326ca0a58">
Aug 26 14:53:17 user nova-compute[73052]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 14:53:17 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:17 user nova-compute[73052]:         <nova:port uuid="6c091ed1-30d3-4b40-985f-2db76f7b8862">
Aug 26 14:53:17 user nova-compute[73052]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 14:53:17 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:17 user nova-compute[73052]:       </nova:ports>
Aug 26 14:53:17 user nova-compute[73052]:     </nova:instance>
Aug 26 14:53:17 user nova-compute[73052]:   </metadata>
Aug 26 14:53:17 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:53:17 user nova-compute[73052]:     <system>
Aug 26 14:53:17 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:53:17 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:53:17 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:53:17 user nova-compute[73052]:       <entry name="serial">4a1dd457-797c-45b6-bc73-c6c5276acacb</entry>
Aug 26 14:53:17 user nova-compute[73052]:       <entry name="uuid">4a1dd457-797c-45b6-bc73-c6c5276acacb</entry>
Aug 26 14:53:17 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:53:17 user nova-compute[73052]:     </system>
Aug 26 14:53:17 user nova-compute[73052]:   </sysinfo>
Aug 26 14:53:17 user nova-compute[73052]:   <os>
Aug 26 14:53:17 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:53:17 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:53:17 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:53:17 user nova-compute[73052]:   </os>
Aug 26 14:53:17 user nova-compute[73052]:   <features>
Aug 26 14:53:17 user nova-compute[73052]:     <acpi/>
Aug 26 14:53:17 user nova-compute[73052]:     <apic/>
Aug 26 14:53:17 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:53:17 user nova-compute[73052]:   </features>
Aug 26 14:53:17 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:53:17 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:53:17 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:53:17 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:53:17 user nova-compute[73052]:   </clock>
Aug 26 14:53:17 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:53:17 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:53:17 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:53:17 user nova-compute[73052]:   </cpu>
Aug 26 14:53:17 user nova-compute[73052]:   <devices>
Aug 26 14:53:17 user nova-compute[73052]:     <disk type="file" device="cdrom">
Aug 26 14:53:17 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 14:53:17 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/4a1dd457-797c-45b6-bc73-c6c5276acacb/disk.config"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="hda" bus="ide"/>
Aug 26 14:53:17 user nova-compute[73052]:     </disk>
Aug 26 14:53:17 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:53:17 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:53:17 user nova-compute[73052]:       <source dev="/dev/sdd"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <serial>5b421b39-c751-436e-98ad-a20e76ad2ccf</serial>
Aug 26 14:53:17 user nova-compute[73052]:     </disk>
Aug 26 14:53:17 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:53:17 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:53:17 user nova-compute[73052]:       <source dev="/dev/sdf"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <serial>ee5347c5-fa97-45fa-9c9f-59da2afc1736</serial>
Aug 26 14:53:17 user nova-compute[73052]:     </disk>
Aug 26 14:53:17 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:53:17 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:53:17 user nova-compute[73052]:       <source dev="/dev/sdg"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="vdc" bus="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <serial>f9726a27-13f2-44e8-8d48-ea28449e4444</serial>
Aug 26 14:53:17 user nova-compute[73052]:     </disk>
Aug 26 14:53:17 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:17 user nova-compute[73052]:       <mac address="fa:16:3e:13:eb:8d"/>
Aug 26 14:53:17 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="tapfcb9c0fc-c9"/>
Aug 26 14:53:17 user nova-compute[73052]:     </interface>
Aug 26 14:53:17 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:17 user nova-compute[73052]:       <mac address="fa:16:3e:d2:ab:47"/>
Aug 26 14:53:17 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="taped152f00-04"/>
Aug 26 14:53:17 user nova-compute[73052]:     </interface>
Aug 26 14:53:17 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:17 user nova-compute[73052]:       <mac address="fa:16:3e:61:5d:09"/>
Aug 26 14:53:17 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="tapa4827275-1e"/>
Aug 26 14:53:17 user nova-compute[73052]:     </interface>
Aug 26 14:53:17 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:17 user nova-compute[73052]:       <mac address="fa:16:3e:a9:e6:5e"/>
Aug 26 14:53:17 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="tap93f8f206-6c"/>
Aug 26 14:53:17 user nova-compute[73052]:     </interface>
Aug 26 14:53:17 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:17 user nova-compute[73052]:       <mac address="fa:16:3e:66:d3:45"/>
Aug 26 14:53:17 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="tap115baf9d-25"/>
Aug 26 14:53:17 user nova-compute[73052]:     </interface>
Aug 26 14:53:17 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:17 user nova-compute[73052]:       <mac address="fa:16:3e:7c:99:2d"/>
Aug 26 14:53:17 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="tap69f52b6e-1f"/>
Aug 26 14:53:17 user nova-compute[73052]:     </interface>
Aug 26 14:53:17 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:17 user nova-compute[73052]:       <mac address="fa:16:3e:f6:b8:0e"/>
Aug 26 14:53:17 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:17 user nova-compute[73052]:       <target dev="tap6c091ed1-30"/>
Aug 26 14:53:17 user nova-compute[73052]:     </interface>
Aug 26 14:53:17 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:53:17 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/4a1dd457-797c-45b6-bc73-c6c5276acacb/console.log" append="off"/>
Aug 26 14:53:17 user nova-compute[73052]:     </serial>
Aug 26 14:53:17 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:53:17 user nova-compute[73052]:     <video>
Aug 26 14:53:17 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:17 user nova-compute[73052]:     </video>
Aug 26 14:53:17 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:53:17 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:53:17 user nova-compute[73052]:     </rng>
Aug 26 14:53:17 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:53:17 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:53:17 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:53:17 user nova-compute[73052]:     </memballoon>
Aug 26 14:53:17 user nova-compute[73052]:   </devices>
Aug 26 14:53:17 user nova-compute[73052]: </domain>
Aug 26 14:53:17 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:eb:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f,network=Network(12509040-b05f-4317-acb8-e6b7b6cbb001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb9c0fc-c9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:eb:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f,network=Network(12509040-b05f-4317-acb8-e6b7b6cbb001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb9c0fc-c9') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Cannot resize image /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Ensure instance console log exists: /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcb9c0fc-c9, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcb9c0fc-c9, col_values=(('external_ids', {'iface-id': 'fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:eb:8d', 'vm-uuid': '4a1dd457-797c-45b6-bc73-c6c5276acacb'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: INFO os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:eb:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f,network=Network(12509040-b05f-4317-acb8-e6b7b6cbb001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb9c0fc-c9')
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ab:47,bridge_name='br-int',has_traffic_filtering=True,id=ed152f00-04c7-4852-a2b8-e0e94a6e94ff,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped152f00-04') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ab:47,bridge_name='br-int',has_traffic_filtering=True,id=ed152f00-04c7-4852-a2b8-e0e94a6e94ff,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped152f00-04') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped152f00-04, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped152f00-04, col_values=(('external_ids', {'iface-id': 'ed152f00-04c7-4852-a2b8-e0e94a6e94ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:ab:47', 'vm-uuid': '4a1dd457-797c-45b6-bc73-c6c5276acacb'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: INFO os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ab:47,bridge_name='br-int',has_traffic_filtering=True,id=ed152f00-04c7-4852-a2b8-e0e94a6e94ff,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped152f00-04')
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5d:09,bridge_name='br-int',has_traffic_filtering=True,id=a4827275-1e85-4b0f-a824-386860a5de8e,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4827275-1e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5d:09,bridge_name='br-int',has_traffic_filtering=True,id=a4827275-1e85-4b0f-a824-386860a5de8e,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4827275-1e') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4827275-1e, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4827275-1e, col_values=(('external_ids', {'iface-id': 'a4827275-1e85-4b0f-a824-386860a5de8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:5d:09', 'vm-uuid': '4a1dd457-797c-45b6-bc73-c6c5276acacb'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: INFO os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5d:09,bridge_name='br-int',has_traffic_filtering=True,id=a4827275-1e85-4b0f-a824-386860a5de8e,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4827275-1e')
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:5e,bridge_name='br-int',has_traffic_filtering=True,id=93f8f206-6c7b-4e89-9172-363eb5dca4db,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8f206-6c') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:5e,bridge_name='br-int',has_traffic_filtering=True,id=93f8f206-6c7b-4e89-9172-363eb5dca4db,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8f206-6c') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93f8f206-6c, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93f8f206-6c, col_values=(('external_ids', {'iface-id': '93f8f206-6c7b-4e89-9172-363eb5dca4db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:e6:5e', 'vm-uuid': '4a1dd457-797c-45b6-bc73-c6c5276acacb'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: INFO os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:5e,bridge_name='br-int',has_traffic_filtering=True,id=93f8f206-6c7b-4e89-9172-363eb5dca4db,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8f206-6c')
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=115baf9d-2558-4071-8b4c-71b1c34b9f35,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115baf9d-25') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=115baf9d-2558-4071-8b4c-71b1c34b9f35,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115baf9d-25') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap115baf9d-25, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap115baf9d-25, col_values=(('external_ids', {'iface-id': '115baf9d-2558-4071-8b4c-71b1c34b9f35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:d3:45', 'vm-uuid': '4a1dd457-797c-45b6-bc73-c6c5276acacb'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: INFO os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=115baf9d-2558-4071-8b4c-71b1c34b9f35,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115baf9d-25')
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:99:2d,bridge_name='br-int',has_traffic_filtering=True,id=69f52b6e-1f9b-4cc6-86d8-37a326ca0a58,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f52b6e-1f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:99:2d,bridge_name='br-int',has_traffic_filtering=True,id=69f52b6e-1f9b-4cc6-86d8-37a326ca0a58,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f52b6e-1f') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69f52b6e-1f, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69f52b6e-1f, col_values=(('external_ids', {'iface-id': '69f52b6e-1f9b-4cc6-86d8-37a326ca0a58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:99:2d', 'vm-uuid': '4a1dd457-797c-45b6-bc73-c6c5276acacb'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: INFO os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:99:2d,bridge_name='br-int',has_traffic_filtering=True,id=69f52b6e-1f9b-4cc6-86d8-37a326ca0a58,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f52b6e-1f')
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b8:0e,bridge_name='br-int',has_traffic_filtering=True,id=6c091ed1-30d3-4b40-985f-2db76f7b8862,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c091ed1-30') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b8:0e,bridge_name='br-int',has_traffic_filtering=True,id=6c091ed1-30d3-4b40-985f-2db76f7b8862,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c091ed1-30') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c091ed1-30, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c091ed1-30, col_values=(('external_ids', {'iface-id': '6c091ed1-30d3-4b40-985f-2db76f7b8862', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:b8:0e', 'vm-uuid': '4a1dd457-797c-45b6-bc73-c6c5276acacb'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:18 user nova-compute[73052]: INFO os_vif [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b8:0e,bridge_name='br-int',has_traffic_filtering=True,id=6c091ed1-30d3-4b40-985f-2db76f7b8862,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c091ed1-30')
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] No BDM found with device name hda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] No VIF found with MAC fa:16:3e:13:eb:8d, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] No VIF found with MAC fa:16:3e:66:d3:45, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:53:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Using config drive
Aug 26 14:53:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Creating config drive at /opt/stack/data/nova/instances/4a1dd457-797c-45b6-bc73-c6c5276acacb/disk.config
Aug 26 14:53:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a1dd457-797c-45b6-bc73-c6c5276acacb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz3f0ky_8 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Successfully updated port: 770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-95ab159c-20c7-436e-8b48-9e1cd3ae37fd req-9cf75525-dcd6-4680-a4d2-94889126040e service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-changed-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.compute.manager [req-95ab159c-20c7-436e-8b48-9e1cd3ae37fd req-9cf75525-dcd6-4680-a4d2-94889126040e service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Refreshing instance network info cache due to event network-changed-770c3e91-7e2f-4dc9-9b6f-395dc26faf87. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-95ab159c-20c7-436e-8b48-9e1cd3ae37fd req-9cf75525-dcd6-4680-a4d2-94889126040e service nova] Acquiring lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-95ab159c-20c7-436e-8b48-9e1cd3ae37fd req-9cf75525-dcd6-4680-a4d2-94889126040e service nova] Acquired lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.neutron [req-95ab159c-20c7-436e-8b48-9e1cd3ae37fd req-9cf75525-dcd6-4680-a4d2-94889126040e service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Refreshing network info cache for port 770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a1dd457-797c-45b6-bc73-c6c5276acacb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz3f0ky_8" returned: 0 in 0.085s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.neutron [req-95ab159c-20c7-436e-8b48-9e1cd3ae37fd req-9cf75525-dcd6-4680-a4d2-94889126040e service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.neutron [req-95ab159c-20c7-436e-8b48-9e1cd3ae37fd req-9cf75525-dcd6-4680-a4d2-94889126040e service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-95ab159c-20c7-436e-8b48-9e1cd3ae37fd req-9cf75525-dcd6-4680-a4d2-94889126040e service nova] Releasing lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquired lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:53:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updating instance_info_cache with network_info: [{"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Releasing lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance network_info: |[{"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Start _get_guest_xml network_info=[{"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:53:19 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:53:19 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2040530059',display_name='tempest-tempest.common.compute-instance-2040530059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2040530059',id=29,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfhquXrIGjGxXYztmgLJzSQQlgnewhkKqp9DxFH0DM8MZ8W5nr5mod0b8V90UIh1B93o92HL2vTz+YFWuNMdp4aBB1FnzjU9k3D0nnFG2lp2L3jpmRp0uRikTpZhcgD7w==',key_name='tempest-keypair-1035979049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-0biclnlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=d8fbdddb-dece-4881-bf03-96040e3c731d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'pci_devices' on Instance uuid d8fbdddb-dece-4881-bf03-96040e3c731d {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:53:19 user nova-compute[73052]:   <uuid>d8fbdddb-dece-4881-bf03-96040e3c731d</uuid>
Aug 26 14:53:19 user nova-compute[73052]:   <name>instance-0000001d</name>
Aug 26 14:53:19 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:53:19 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:53:19 user nova-compute[73052]:   <metadata>
Aug 26 14:53:19 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:53:19 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:53:19 user nova-compute[73052]:       <nova:name>tempest-tempest.common.compute-instance-2040530059</nova:name>
Aug 26 14:53:19 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:53:19</nova:creationTime>
Aug 26 14:53:19 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:53:19 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:53:19 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:53:19 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:53:19 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:53:19 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:53:19 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:53:19 user nova-compute[73052]:       <nova:owner>
Aug 26 14:53:19 user nova-compute[73052]:         <nova:user uuid="5061033588974e7ead6c7abc8a47308e">tempest-ServerActionsTestOtherA-1682869035-project-member</nova:user>
Aug 26 14:53:19 user nova-compute[73052]:         <nova:project uuid="eb3fc9a170804f0ebfa2dde967e3fec2">tempest-ServerActionsTestOtherA-1682869035</nova:project>
Aug 26 14:53:19 user nova-compute[73052]:       </nova:owner>
Aug 26 14:53:19 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:53:19 user nova-compute[73052]:       <nova:ports>
Aug 26 14:53:19 user nova-compute[73052]:         <nova:port uuid="770c3e91-7e2f-4dc9-9b6f-395dc26faf87">
Aug 26 14:53:19 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 14:53:19 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:19 user nova-compute[73052]:       </nova:ports>
Aug 26 14:53:19 user nova-compute[73052]:     </nova:instance>
Aug 26 14:53:19 user nova-compute[73052]:   </metadata>
Aug 26 14:53:19 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:53:19 user nova-compute[73052]:     <system>
Aug 26 14:53:19 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:53:19 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:53:19 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:53:19 user nova-compute[73052]:       <entry name="serial">d8fbdddb-dece-4881-bf03-96040e3c731d</entry>
Aug 26 14:53:19 user nova-compute[73052]:       <entry name="uuid">d8fbdddb-dece-4881-bf03-96040e3c731d</entry>
Aug 26 14:53:19 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:53:19 user nova-compute[73052]:     </system>
Aug 26 14:53:19 user nova-compute[73052]:   </sysinfo>
Aug 26 14:53:19 user nova-compute[73052]:   <os>
Aug 26 14:53:19 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:53:19 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:53:19 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:53:19 user nova-compute[73052]:   </os>
Aug 26 14:53:19 user nova-compute[73052]:   <features>
Aug 26 14:53:19 user nova-compute[73052]:     <acpi/>
Aug 26 14:53:19 user nova-compute[73052]:     <apic/>
Aug 26 14:53:19 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:53:19 user nova-compute[73052]:   </features>
Aug 26 14:53:19 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:53:19 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:53:19 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:53:19 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:53:19 user nova-compute[73052]:   </clock>
Aug 26 14:53:19 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:53:19 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:53:19 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:53:19 user nova-compute[73052]:   </cpu>
Aug 26 14:53:19 user nova-compute[73052]:   <devices>
Aug 26 14:53:19 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:53:19 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:53:19 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk"/>
Aug 26 14:53:19 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:53:19 user nova-compute[73052]:     </disk>
Aug 26 14:53:19 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:19 user nova-compute[73052]:       <mac address="fa:16:3e:22:ab:2e"/>
Aug 26 14:53:19 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:19 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:19 user nova-compute[73052]:       <target dev="tap770c3e91-7e"/>
Aug 26 14:53:19 user nova-compute[73052]:     </interface>
Aug 26 14:53:19 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:53:19 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/console.log" append="off"/>
Aug 26 14:53:19 user nova-compute[73052]:     </serial>
Aug 26 14:53:19 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:53:19 user nova-compute[73052]:     <video>
Aug 26 14:53:19 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:19 user nova-compute[73052]:     </video>
Aug 26 14:53:19 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:53:19 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:53:19 user nova-compute[73052]:     </rng>
Aug 26 14:53:19 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:53:19 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:53:19 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:53:19 user nova-compute[73052]:     </memballoon>
Aug 26 14:53:19 user nova-compute[73052]:   </devices>
Aug 26 14:53:19 user nova-compute[73052]: </domain>
Aug 26 14:53:19 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2040530059',display_name='tempest-tempest.common.compute-instance-2040530059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2040530059',id=29,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfhquXrIGjGxXYztmgLJzSQQlgnewhkKqp9DxFH0DM8MZ8W5nr5mod0b8V90UIh1B93o92HL2vTz+YFWuNMdp4aBB1FnzjU9k3D0nnFG2lp2L3jpmRp0uRikTpZhcgD7w==',key_name='tempest-keypair-1035979049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-0biclnlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=d8fbdddb-dece-4881-bf03-96040e3c731d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG os_vif [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap770c3e91-7e, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap770c3e91-7e, col_values=(('external_ids', {'iface-id': '770c3e91-7e2f-4dc9-9b6f-395dc26faf87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ab:2e', 'vm-uuid': 'd8fbdddb-dece-4881-bf03-96040e3c731d'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:19 user nova-compute[73052]: INFO os_vif [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e')
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No VIF found with MAC fa:16:3e:22:ab:2e, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:53:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-bd430dbb-dcb7-4f14-b967-a6539cb4d2ff req-040c31f1-7bb7-4938-80d2-c7cf9c724af4 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received event network-changed-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-bd430dbb-dcb7-4f14-b967-a6539cb4d2ff req-040c31f1-7bb7-4938-80d2-c7cf9c724af4 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Refreshing instance network info cache due to event network-changed-75a40adb-a6f1-417c-a129-41ea989a0334. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bd430dbb-dcb7-4f14-b967-a6539cb4d2ff req-040c31f1-7bb7-4938-80d2-c7cf9c724af4 service nova] Acquiring lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bd430dbb-dcb7-4f14-b967-a6539cb4d2ff req-040c31f1-7bb7-4938-80d2-c7cf9c724af4 service nova] Acquired lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-bd430dbb-dcb7-4f14-b967-a6539cb4d2ff req-040c31f1-7bb7-4938-80d2-c7cf9c724af4 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Refreshing network info cache for port 75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-bd430dbb-dcb7-4f14-b967-a6539cb4d2ff req-040c31f1-7bb7-4938-80d2-c7cf9c724af4 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Updated VIF entry in instance network info cache for port 75a40adb-a6f1-417c-a129-41ea989a0334. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-bd430dbb-dcb7-4f14-b967-a6539cb4d2ff req-040c31f1-7bb7-4938-80d2-c7cf9c724af4 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Updating instance_info_cache with network_info: [{"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bd430dbb-dcb7-4f14-b967-a6539cb4d2ff req-040c31f1-7bb7-4938-80d2-c7cf9c724af4 service nova] Releasing lock "refresh_cache-7acb8d8e-f559-412c-91b3-e20f2df2a09a" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:53:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-32fc9596-dad3-4280-a1b1-8b3c0c2472d6 req-e7b41880-86d2-43bd-8a3a-71ae63d339fe service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32fc9596-dad3-4280-a1b1-8b3c0c2472d6 req-e7b41880-86d2-43bd-8a3a-71ae63d339fe service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32fc9596-dad3-4280-a1b1-8b3c0c2472d6 req-e7b41880-86d2-43bd-8a3a-71ae63d339fe service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32fc9596-dad3-4280-a1b1-8b3c0c2472d6 req-e7b41880-86d2-43bd-8a3a-71ae63d339fe service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-32fc9596-dad3-4280-a1b1-8b3c0c2472d6 req-e7b41880-86d2-43bd-8a3a-71ae63d339fe service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:22 user nova-compute[73052]: WARNING nova.compute.manager [req-32fc9596-dad3-4280-a1b1-8b3c0c2472d6 req-e7b41880-86d2-43bd-8a3a-71ae63d339fe service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db for instance with vm_state building and task_state spawning.
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:22 user nova-compute[73052]: WARNING nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f for instance with vm_state building and task_state spawning.
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:22 user nova-compute[73052]: WARNING nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f for instance with vm_state building and task_state spawning.
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:22 user nova-compute[73052]: WARNING nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff for instance with vm_state building and task_state spawning.
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:22 user nova-compute[73052]: WARNING nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff for instance with vm_state building and task_state spawning.
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-a4827275-1e85-4b0f-a824-386860a5de8e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-a4827275-1e85-4b0f-a824-386860a5de8e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:22 user nova-compute[73052]: WARNING nova.compute.manager [req-683d65dc-4390-4c98-9f37-3dee7f8cde34 req-9a6d3d4d-634d-4d88-95c6-5e0a6dce44e0 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-a4827275-1e85-4b0f-a824-386860a5de8e for instance with vm_state building and task_state spawning.
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: INFO nova.compute.manager [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Terminating instance
Aug 26 14:53:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:23 user nova-compute[73052]: INFO nova.compute.manager [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Terminating instance
Aug 26 14:53:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-74191457-ac9c-43a1-bf8f-ada265b2c814 req-8db4592a-04d6-401a-8fe3-01cf432c1e90 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-unplugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74191457-ac9c-43a1-bf8f-ada265b2c814 req-8db4592a-04d6-401a-8fe3-01cf432c1e90 service nova] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74191457-ac9c-43a1-bf8f-ada265b2c814 req-8db4592a-04d6-401a-8fe3-01cf432c1e90 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74191457-ac9c-43a1-bf8f-ada265b2c814 req-8db4592a-04d6-401a-8fe3-01cf432c1e90 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-74191457-ac9c-43a1-bf8f-ada265b2c814 req-8db4592a-04d6-401a-8fe3-01cf432c1e90 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] No waiting events found dispatching network-vif-unplugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-74191457-ac9c-43a1-bf8f-ada265b2c814 req-8db4592a-04d6-401a-8fe3-01cf432c1e90 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-unplugged-25613dee-a11d-49c8-aeba-808b01197e7a for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:24 user nova-compute[73052]: WARNING nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db for instance with vm_state building and task_state spawning.
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] No waiting events found dispatching network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:24 user nova-compute[73052]: WARNING nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received unexpected event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 for instance with vm_state building and task_state spawning.
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] No waiting events found dispatching network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:24 user nova-compute[73052]: WARNING nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received unexpected event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 for instance with vm_state building and task_state spawning.
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:24 user nova-compute[73052]: WARNING nova.compute.manager [req-04004ea7-6c87-4e7f-a9c4-0df8dc41e908 req-5a1c0529-eb1c-4462-9a54-e7882c53f03a service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 for instance with vm_state building and task_state spawning.
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-d583f024-18c7-4c1d-8925-dccb1ef76b1b req-f800feae-ae41-40dc-a8bc-ba34164d3e70 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-a4827275-1e85-4b0f-a824-386860a5de8e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d583f024-18c7-4c1d-8925-dccb1ef76b1b req-f800feae-ae41-40dc-a8bc-ba34164d3e70 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d583f024-18c7-4c1d-8925-dccb1ef76b1b req-f800feae-ae41-40dc-a8bc-ba34164d3e70 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d583f024-18c7-4c1d-8925-dccb1ef76b1b req-f800feae-ae41-40dc-a8bc-ba34164d3e70 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-d583f024-18c7-4c1d-8925-dccb1ef76b1b req-f800feae-ae41-40dc-a8bc-ba34164d3e70 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-a4827275-1e85-4b0f-a824-386860a5de8e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:24 user nova-compute[73052]: WARNING nova.compute.manager [req-d583f024-18c7-4c1d-8925-dccb1ef76b1b req-f800feae-ae41-40dc-a8bc-ba34164d3e70 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-a4827275-1e85-4b0f-a824-386860a5de8e for instance with vm_state building and task_state spawning.
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Instance destroyed successfully.
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lazy-loading 'resources' on Instance uuid 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-974097995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-974097995',id=20,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxkGTZIwhwifi3AWxYsd1u+oJMT8+InAe7LUzawcAt5ZVVe6ftgimyrZAKb0Dc7pG5Q2DKzybFjs3hwqYCtXQJiZGbrheLePJ6Q6iK9gnk0vPOJbjPbxoF3B7JweqYXbQ==',key_name='tempest-keypair-746986181',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:51:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e3757f3624d869a2e5e3d31376b5c',ramdisk_id='',reservation_id='r-bawqgpzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1914851903',owner_user_name='tempest-AttachVolumeShelveTestJSON-1914851903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2513642eea3411b9c8c33714bd2f3b3',uuid=83e00d7a-c0a0-4e39-af7c-c2fb9a564406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converting VIF {"id": "25613dee-a11d-49c8-aeba-808b01197e7a", "address": "fa:16:3e:a7:bd:76", "network": {"id": "a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-647071737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e3757f3624d869a2e5e3d31376b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25613dee-a1", "ovs_interfaceid": "25613dee-a11d-49c8-aeba-808b01197e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG os_vif [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25613dee-a1, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: INFO os_vif [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=25613dee-a11d-49c8-aeba-808b01197e7a,network=Network(a2b430f6-2c82-4aba-a2f6-dd3f4ac9fa27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25613dee-a1')
Aug 26 14:53:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Deleting instance files /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406_del
Aug 26 14:53:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Deletion of /opt/stack/data/nova/instances/83e00d7a-c0a0-4e39-af7c-c2fb9a564406_del complete
Aug 26 14:53:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Instance destroyed successfully.
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.objects.instance [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lazy-loading 'resources' on Instance uuid 92558f0f-dc80-4acf-b3b9-27d0244c0ddb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-947691108',display_name='tempest-SnapshotDataIntegrityTests-server-947691108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-947691108',id=15,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFARuMWaLpakQC1Chj5dvFlLhFbhL3fqQQApOyrJZDcX18w2H/jHD4+P2UYoItEfr9CGTp2aGeEoBW08djudZ+SOMDbVDkybww9hYmp6J+qWKRToUaBIMpKVW4kQvDUxyA==',key_name='tempest-keypair-705788914',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:45:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b08a7ce6c2c74c688c44fabc053c39cb',ramdisk_id='',reservation_id='r-f9zjhl30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1799889378',owner_user_name='tempest-SnapshotDataIntegrityTests-1799889378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f305d2512943078f5523a3ab1714d3',uuid=92558f0f-dc80-4acf-b3b9-27d0244c0ddb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Converting VIF {"id": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "address": "fa:16:3e:51:e9:f0", "network": {"id": "a1f0df7f-0f79-440e-b39d-ae68b13a7832", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1707490201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b08a7ce6c2c74c688c44fabc053c39cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6ce89f-52", "ovs_interfaceid": "8b6ce89f-520f-4036-82f8-aff1776d0b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:e9:f0,bridge_name='br-int',has_traffic_filtering=True,id=8b6ce89f-520f-4036-82f8-aff1776d0b75,network=Network(a1f0df7f-0f79-440e-b39d-ae68b13a7832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6ce89f-52') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG os_vif [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e9:f0,bridge_name='br-int',has_traffic_filtering=True,id=8b6ce89f-520f-4036-82f8-aff1776d0b75,network=Network(a1f0df7f-0f79-440e-b39d-ae68b13a7832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6ce89f-52') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b6ce89f-52, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:24 user nova-compute[73052]: INFO os_vif [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e9:f0,bridge_name='br-int',has_traffic_filtering=True,id=8b6ce89f-520f-4036-82f8-aff1776d0b75,network=Network(a1f0df7f-0f79-440e-b39d-ae68b13a7832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6ce89f-52')
Aug 26 14:53:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Deleting instance files /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb_del
Aug 26 14:53:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Deletion of /opt/stack/data/nova/instances/92558f0f-dc80-4acf-b3b9-27d0244c0ddb_del complete
Aug 26 14:53:25 user nova-compute[73052]: INFO nova.compute.manager [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Took 1.78 seconds to destroy the instance on the hypervisor.
Aug 26 14:53:25 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:53:25 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:53:25 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:53:25 user nova-compute[73052]: INFO nova.compute.manager [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Took 1.64 seconds to destroy the instance on the hypervisor.
Aug 26 14:53:25 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:53:25 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:53:25 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:53:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:25 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:25 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Took 0.88 seconds to deallocate network for instance.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Acquiring lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] No waiting events found dispatching network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:26 user nova-compute[73052]: WARNING nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received unexpected event network-vif-plugged-25613dee-a11d-49c8-aeba-808b01197e7a for instance with vm_state active and task_state deleting.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:26 user nova-compute[73052]: WARNING nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 for instance with vm_state building and task_state spawning.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:26 user nova-compute[73052]: WARNING nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 for instance with vm_state building and task_state spawning.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received event network-vif-unplugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] No waiting events found dispatching network-vif-unplugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:26 user nova-compute[73052]: WARNING nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received unexpected event network-vif-unplugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 for instance with vm_state deleted and task_state None.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received event network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Acquiring lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] No waiting events found dispatching network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:26 user nova-compute[73052]: WARNING nova.compute.manager [req-971818b8-5f7c-4e89-9102-95a73af86c6a req-cf43ae2b-a03f-4523-bbbc-50da705cc004 service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received unexpected event network-vif-plugged-8b6ce89f-520f-4036-82f8-aff1776d0b75 for instance with vm_state deleted and task_state None.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:26 user nova-compute[73052]: WARNING nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 for instance with vm_state building and task_state spawning.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:26 user nova-compute[73052]: WARNING nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 for instance with vm_state building and task_state spawning.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:26 user nova-compute[73052]: WARNING nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 for instance with vm_state building and task_state spawning.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2240627-0287-40ff-a91a-4bdbbd594375 req-8c53aa23-faf5-40e1-9d8e-e42b95c108da service nova] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Received event network-vif-deleted-8b6ce89f-520f-4036-82f8-aff1776d0b75 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Took 1.46 seconds to deallocate network for instance.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Deleted allocations for instance 92558f0f-dc80-4acf-b3b9-27d0244c0ddb
Aug 26 14:53:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-43459f02-311b-4a26-b0f0-df51a79e7576 tempest-SnapshotDataIntegrityTests-1799889378 tempest-SnapshotDataIntegrityTests-1799889378-project-member] Lock "92558f0f-dc80-4acf-b3b9-27d0244c0ddb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.271s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061606.67327, d8fbdddb-dece-4881-bf03-96040e3c731d => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] VM Resumed (Lifecycle Event)
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance spawned successfully.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061606.6742382, d8fbdddb-dece-4881-bf03-96040e3c731d => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] VM Started (Lifecycle Event)
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Took 9.76 seconds to spawn the instance on the hypervisor.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061606.8452775, 4a1dd457-797c-45b6-bc73-c6c5276acacb => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] VM Resumed (Lifecycle Event)
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance spawned successfully.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061606.845499, 4a1dd457-797c-45b6-bc73-c6c5276acacb => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] VM Started (Lifecycle Event)
Aug 26 14:53:26 user nova-compute[73052]: INFO nova.compute.manager [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Took 10.60 seconds to build instance.
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:53:27 user nova-compute[73052]: INFO nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Took 14.63 seconds to spawn the instance on the hypervisor.
Aug 26 14:53:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c07bd496-5b0d-4220-8b5e-7b97e127853e tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.755s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:27 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:53:27 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Deleted allocations for instance 83e00d7a-c0a0-4e39-af7c-c2fb9a564406
Aug 26 14:53:27 user nova-compute[73052]: INFO nova.compute.manager [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Took 54.07 seconds to build instance.
Aug 26 14:53:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c80c4f83-74f1-479c-bfb1-c36120079610 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.184s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2c32d97e-7a15-4588-b0e7-6e325cec118c tempest-AttachVolumeShelveTestJSON-1914851903 tempest-AttachVolumeShelveTestJSON-1914851903-project-member] Lock "83e00d7a-c0a0-4e39-af7c-c2fb9a564406" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.948s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-89445869-784d-4c0a-8db5-23a69d946778 req-e6851789-d7f8-4643-b61f-d59953d4e0cf service nova] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Received event network-vif-deleted-25613dee-a11d-49c8-aeba-808b01197e7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:53:34 user nova-compute[73052]: INFO nova.compute.claims [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Claim successful on node user
Aug 26 14:53:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:53:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:53:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:53:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:53:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:53:35 user nova-compute[73052]: INFO nova.virt.block_device [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Booting with volume snapshot 7bc8a818-8cb2-4c96-bf39-6f8aa9b54d72 at /dev/vda
Aug 26 14:53:35 user nova-compute[73052]: DEBUG nova.policy [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce6cd78a2f7c407983d90a15ffb94967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8ab154558a4521920e05921722db36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:53:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Successfully created port: 93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:53:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Successfully updated port: 93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:53:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:53:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquired lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:53:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:53:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-179184ea-13db-4b99-944b-953c2e5818c5 req-dbc471cd-bd23-4174-939b-b747326c5eaa service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received event network-changed-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-179184ea-13db-4b99-944b-953c2e5818c5 req-dbc471cd-bd23-4174-939b-b747326c5eaa service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Refreshing instance network info cache due to event network-changed-93bd7100-3306-44b9-b79a-7f693b42fd50. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:53:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-179184ea-13db-4b99-944b-953c2e5818c5 req-dbc471cd-bd23-4174-939b-b747326c5eaa service nova] Acquiring lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:53:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:53:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Updating instance_info_cache with network_info: [{"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Releasing lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:53:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Instance network_info: |[{"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:53:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-179184ea-13db-4b99-944b-953c2e5818c5 req-dbc471cd-bd23-4174-939b-b747326c5eaa service nova] Acquired lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:53:37 user nova-compute[73052]: DEBUG nova.network.neutron [req-179184ea-13db-4b99-944b-953c2e5818c5 req-dbc471cd-bd23-4174-939b-b747326c5eaa service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Refreshing network info cache for port 93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:53:37 user nova-compute[73052]: DEBUG nova.network.neutron [req-179184ea-13db-4b99-944b-953c2e5818c5 req-dbc471cd-bd23-4174-939b-b747326c5eaa service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Updated VIF entry in instance network info cache for port 93bd7100-3306-44b9-b79a-7f693b42fd50. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:53:37 user nova-compute[73052]: DEBUG nova.network.neutron [req-179184ea-13db-4b99-944b-953c2e5818c5 req-dbc471cd-bd23-4174-939b-b747326c5eaa service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Updating instance_info_cache with network_info: [{"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-179184ea-13db-4b99-944b-953c2e5818c5 req-dbc471cd-bd23-4174-939b-b747326c5eaa service nova] Releasing lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:53:39 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061604.731667, 83e00d7a-c0a0-4e39-af7c-c2fb9a564406 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:53:39 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] VM Stopped (Lifecycle Event)
Aug 26 14:53:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1a05a5de-b5a4-4387-ab29-13e6ed54f33e None None] [instance: 83e00d7a-c0a0-4e39-af7c-c2fb9a564406] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:39 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061604.7907517, 92558f0f-dc80-4acf-b3b9-27d0244c0ddb => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:53:39 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] VM Stopped (Lifecycle Event)
Aug 26 14:53:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fe3b8abb-d8e4-414c-b455-51d9e0012457 None None] [instance: 92558f0f-dc80-4acf-b3b9-27d0244c0ddb] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:53:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:53:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:53:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG os_brick.utils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[17997d18-4d59-4ce4-ace9-96a597f6db2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d01b2cd-5a82-4cfb-940c-0d05bcc61652]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcf856e-d61e-4b17-9246-45fe90f37caa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc216d1a-b753-4585-96db-41f5fc4ee71b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:53:40 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:53:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[da172179-0602-432b-bb5c-1bb965e6aa90]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG os_brick.utils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:53:40 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Updating existing volume attachment record: 5fb9b919-52a8-4c0e-9bb9-bf218dc4f788 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:53:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:50 user nova-compute[73052]: INFO nova.compute.manager [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Terminating instance
Aug 26 14:53:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-36b1a340-a163-40c6-94de-c5e5c6dfec87 req-a8b9fef5-c0a1-47b1-b3c5-58d481ba0960 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received event network-vif-unplugged-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-36b1a340-a163-40c6-94de-c5e5c6dfec87 req-a8b9fef5-c0a1-47b1-b3c5-58d481ba0960 service nova] Acquiring lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-36b1a340-a163-40c6-94de-c5e5c6dfec87 req-a8b9fef5-c0a1-47b1-b3c5-58d481ba0960 service nova] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-36b1a340-a163-40c6-94de-c5e5c6dfec87 req-a8b9fef5-c0a1-47b1-b3c5-58d481ba0960 service nova] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-36b1a340-a163-40c6-94de-c5e5c6dfec87 req-a8b9fef5-c0a1-47b1-b3c5-58d481ba0960 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] No waiting events found dispatching network-vif-unplugged-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-36b1a340-a163-40c6-94de-c5e5c6dfec87 req-a8b9fef5-c0a1-47b1-b3c5-58d481ba0960 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received event network-vif-unplugged-2d056b65-479a-43d0-96d1-9c53377bea9e for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:53:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Instance destroyed successfully.
Aug 26 14:53:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lazy-loading 'resources' on Instance uuid 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:51:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-607164700',display_name='tempest-VolumesActionsTest-instance-607164700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-607164700',id=26,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c1afa5dd9c74414a874e103410b71be',ramdisk_id='',reservation_id='r-rnl9fdkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1775568266',owner_user_name='tempest-VolumesActionsTest-1775568266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:52:08Z,user_data=None,user_id='ed5225f2064f43e893a054c3583a0b8f',uuid=8c5ecea5-aa8d-4743-9109-cab8a5e81e2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converting VIF {"id": "2d056b65-479a-43d0-96d1-9c53377bea9e", "address": "fa:16:3e:c3:19:fb", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d056b65-47", "ovs_interfaceid": "2d056b65-479a-43d0-96d1-9c53377bea9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:fb,bridge_name='br-int',has_traffic_filtering=True,id=2d056b65-479a-43d0-96d1-9c53377bea9e,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d056b65-47') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG os_vif [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:fb,bridge_name='br-int',has_traffic_filtering=True,id=2d056b65-479a-43d0-96d1-9c53377bea9e,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d056b65-47') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d056b65-47, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:50 user nova-compute[73052]: INFO os_vif [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:fb,bridge_name='br-int',has_traffic_filtering=True,id=2d056b65-479a-43d0-96d1-9c53377bea9e,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d056b65-47')
Aug 26 14:53:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Deleting instance files /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d_del
Aug 26 14:53:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Deletion of /opt/stack/data/nova/instances/8c5ecea5-aa8d-4743-9109-cab8a5e81e2d_del complete
Aug 26 14:53:51 user nova-compute[73052]: INFO nova.compute.manager [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 26 14:53:51 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:53:51 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:53:51 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:53:51 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:53:51 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Took 0.48 seconds to deallocate network for instance.
Aug 26 14:53:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:51 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:53:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:53:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:51 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Deleted allocations for instance 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d
Aug 26 14:53:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a6e3c3de-a198-4ab5-9b24-c0b7dafc0dea tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.701s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-1da699e2-0e95-4836-8fae-e10f419b23b8 req-98af824c-d83a-46f6-b7a1-7e044a5b4983 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received event network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1da699e2-0e95-4836-8fae-e10f419b23b8 req-98af824c-d83a-46f6-b7a1-7e044a5b4983 service nova] Acquiring lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1da699e2-0e95-4836-8fae-e10f419b23b8 req-98af824c-d83a-46f6-b7a1-7e044a5b4983 service nova] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1da699e2-0e95-4836-8fae-e10f419b23b8 req-98af824c-d83a-46f6-b7a1-7e044a5b4983 service nova] Lock "8c5ecea5-aa8d-4743-9109-cab8a5e81e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-1da699e2-0e95-4836-8fae-e10f419b23b8 req-98af824c-d83a-46f6-b7a1-7e044a5b4983 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] No waiting events found dispatching network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:52 user nova-compute[73052]: WARNING nova.compute.manager [req-1da699e2-0e95-4836-8fae-e10f419b23b8 req-98af824c-d83a-46f6-b7a1-7e044a5b4983 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received unexpected event network-vif-plugged-2d056b65-479a-43d0-96d1-9c53377bea9e for instance with vm_state deleted and task_state None.
Aug 26 14:53:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-1da699e2-0e95-4836-8fae-e10f419b23b8 req-98af824c-d83a-46f6-b7a1-7e044a5b4983 service nova] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Received event network-vif-deleted-2d056b65-479a-43d0-96d1-9c53377bea9e {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:53:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:53:53 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Creating image(s)
Aug 26 14:53:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:53:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Ensure instance console log exists: /opt/stack/data/nova/instances/75b47e02-ff4b-4c57-93d3-4bca7eacc737/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:53:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Start _get_guest_xml network_info=[{"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T14:53:22Z,direct_url=<?>,disk_format='qcow2',id=4e9fb336-9278-402b-ac95-ae36540f972f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-800827506',owner='1e8ab154558a4521920e05921722db36',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T14:53:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '5fb9b919-52a8-4c0e-9bb9-bf218dc4f788', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IymAVxSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75b47e02-ff4b-4c57-93d3-4bca7eacc737', 'attached_at': '', 'detached_at': '', 'volume_id': '0537c791-ba63-4e18-a095-e9485f093f9f', 'serial': '0537c791-ba63-4e18-a095-e9485f093f9f'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:53:53 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:53:53 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:53:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:53:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T14:53:22Z,direct_url=<?>,disk_format='qcow2',id=4e9fb336-9278-402b-ac95-ae36540f972f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-800827506',owner='1e8ab154558a4521920e05921722db36',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T14:53:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IymAVxSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:53:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:53:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:53:54 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[41827bad-9b67-4b8a-96ac-e3dcb16f4a8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:53:54 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a835914d-e3e7-47ce-a3aa-c4e4e5cb9d10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f] added
Aug 26 14:53:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65c51f7-ffb6-4a54-894c-48ad562be77d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b0720b-0c70-4e41-9173-93bcbf429431]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IymAVxSd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IymAVxSd" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[253a7773-2bcb-4f43-a774-0710a669cfa9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IymAVxSd'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[936874f4-6931-4128-9f6c-bca815164b9c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[938c5e96-b7d6-40e9-8e0e-493650b230fb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f89ea-e10a-4423-97da-277f9f8045f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f, portal: 172.16.0.220,3260]
Aug 26 14:53:54 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f, portal: 172.16.0.220,3260] successful.
Aug 26 14:53:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21bb68b-d349-4e34-a8a3-9bc66b9095cb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7089a85-585a-4766-8088-bd7f67c4550d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:53:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:53:54 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:53:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df3bc76-e2d5-49c4-9779-4adb9ab37fd8]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IymAVxSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:53:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23838333639643131', 'path': '/dev/sdh'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838333639643131', 'path': '/dev/sdh'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1504653365',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1504653365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1504653365',id=30,image_ref='4e9fb336-9278-402b-ac95-ae36540f972f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrMZYhP7RjTTZSBWjd0i2uapmfR6RNxQ3oD5MFJO559cn9tJXGFZ9y/sutBjhG9CwdOmj7EVjp/3e317pplvTvzkLdQsO8CxPHyAK4qoJevI2pdE7STAuzxCniNc3e35g==',key_name='tempest-keypair-1439082707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-x2zl4q60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-772605316',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=75b47e02-ff4b-4c57-93d3-4bca7eacc737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:be:25,bridge_name='br-int',has_traffic_filtering=True,id=93bd7100-3306-44b9-b79a-7f693b42fd50,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bd7100-33') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'pci_devices' on Instance uuid 75b47e02-ff4b-4c57-93d3-4bca7eacc737 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:53:55 user nova-compute[73052]:   <uuid>75b47e02-ff4b-4c57-93d3-4bca7eacc737</uuid>
Aug 26 14:53:55 user nova-compute[73052]:   <name>instance-0000001e</name>
Aug 26 14:53:55 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:53:55 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:53:55 user nova-compute[73052]:   <metadata>
Aug 26 14:53:55 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:53:55 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:53:55 user nova-compute[73052]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1504653365</nova:name>
Aug 26 14:53:55 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:53:53</nova:creationTime>
Aug 26 14:53:55 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:53:55 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:53:55 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:53:55 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:53:55 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:53:55 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:53:55 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:53:55 user nova-compute[73052]:       <nova:owner>
Aug 26 14:53:55 user nova-compute[73052]:         <nova:user uuid="ce6cd78a2f7c407983d90a15ffb94967">tempest-TestVolumeBootPattern-772605316-project-member</nova:user>
Aug 26 14:53:55 user nova-compute[73052]:         <nova:project uuid="1e8ab154558a4521920e05921722db36">tempest-TestVolumeBootPattern-772605316</nova:project>
Aug 26 14:53:55 user nova-compute[73052]:       </nova:owner>
Aug 26 14:53:55 user nova-compute[73052]:       <nova:root type="image" uuid="4e9fb336-9278-402b-ac95-ae36540f972f"/>
Aug 26 14:53:55 user nova-compute[73052]:       <nova:ports>
Aug 26 14:53:55 user nova-compute[73052]:         <nova:port uuid="93bd7100-3306-44b9-b79a-7f693b42fd50">
Aug 26 14:53:55 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 14:53:55 user nova-compute[73052]:         </nova:port>
Aug 26 14:53:55 user nova-compute[73052]:       </nova:ports>
Aug 26 14:53:55 user nova-compute[73052]:     </nova:instance>
Aug 26 14:53:55 user nova-compute[73052]:   </metadata>
Aug 26 14:53:55 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:53:55 user nova-compute[73052]:     <system>
Aug 26 14:53:55 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:53:55 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:53:55 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:53:55 user nova-compute[73052]:       <entry name="serial">75b47e02-ff4b-4c57-93d3-4bca7eacc737</entry>
Aug 26 14:53:55 user nova-compute[73052]:       <entry name="uuid">75b47e02-ff4b-4c57-93d3-4bca7eacc737</entry>
Aug 26 14:53:55 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:53:55 user nova-compute[73052]:     </system>
Aug 26 14:53:55 user nova-compute[73052]:   </sysinfo>
Aug 26 14:53:55 user nova-compute[73052]:   <os>
Aug 26 14:53:55 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:53:55 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:53:55 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:53:55 user nova-compute[73052]:   </os>
Aug 26 14:53:55 user nova-compute[73052]:   <features>
Aug 26 14:53:55 user nova-compute[73052]:     <acpi/>
Aug 26 14:53:55 user nova-compute[73052]:     <apic/>
Aug 26 14:53:55 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:53:55 user nova-compute[73052]:   </features>
Aug 26 14:53:55 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:53:55 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:53:55 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:53:55 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:53:55 user nova-compute[73052]:   </clock>
Aug 26 14:53:55 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:53:55 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:53:55 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:53:55 user nova-compute[73052]:   </cpu>
Aug 26 14:53:55 user nova-compute[73052]:   <devices>
Aug 26 14:53:55 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:53:55 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:53:55 user nova-compute[73052]:       <source dev="/dev/sdh"/>
Aug 26 14:53:55 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:53:55 user nova-compute[73052]:       <serial>0537c791-ba63-4e18-a095-e9485f093f9f</serial>
Aug 26 14:53:55 user nova-compute[73052]:     </disk>
Aug 26 14:53:55 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:53:55 user nova-compute[73052]:       <mac address="fa:16:3e:e6:be:25"/>
Aug 26 14:53:55 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:55 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:53:55 user nova-compute[73052]:       <target dev="tap93bd7100-33"/>
Aug 26 14:53:55 user nova-compute[73052]:     </interface>
Aug 26 14:53:55 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:53:55 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/75b47e02-ff4b-4c57-93d3-4bca7eacc737/console.log" append="off"/>
Aug 26 14:53:55 user nova-compute[73052]:     </serial>
Aug 26 14:53:55 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:53:55 user nova-compute[73052]:     <video>
Aug 26 14:53:55 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:53:55 user nova-compute[73052]:     </video>
Aug 26 14:53:55 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:53:55 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:53:55 user nova-compute[73052]:     </rng>
Aug 26 14:53:55 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:53:55 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:53:55 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:53:55 user nova-compute[73052]:     </memballoon>
Aug 26 14:53:55 user nova-compute[73052]:   </devices>
Aug 26 14:53:55 user nova-compute[73052]: </domain>
Aug 26 14:53:55 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1504653365',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1504653365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1504653365',id=30,image_ref='4e9fb336-9278-402b-ac95-ae36540f972f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrMZYhP7RjTTZSBWjd0i2uapmfR6RNxQ3oD5MFJO559cn9tJXGFZ9y/sutBjhG9CwdOmj7EVjp/3e317pplvTvzkLdQsO8CxPHyAK4qoJevI2pdE7STAuzxCniNc3e35g==',key_name='tempest-keypair-1439082707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-x2zl4q60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-772605316',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=75b47e02-ff4b-4c57-93d3-4bca7eacc737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:be:25,bridge_name='br-int',has_traffic_filtering=True,id=93bd7100-3306-44b9-b79a-7f693b42fd50,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bd7100-33') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG os_vif [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:be:25,bridge_name='br-int',has_traffic_filtering=True,id=93bd7100-3306-44b9-b79a-7f693b42fd50,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bd7100-33') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93bd7100-33, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93bd7100-33, col_values=(('external_ids', {'iface-id': '93bd7100-3306-44b9-b79a-7f693b42fd50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:be:25', 'vm-uuid': '75b47e02-ff4b-4c57-93d3-4bca7eacc737'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:55 user nova-compute[73052]: INFO os_vif [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:be:25,bridge_name='br-int',has_traffic_filtering=True,id=93bd7100-3306-44b9-b79a-7f693b42fd50,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bd7100-33')
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:53:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No VIF found with MAC fa:16:3e:e6:be:25, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG nova.compute.manager [req-4a5a150a-2b0c-4b07-82c2-2c205fca6414 req-4fb2e286-07b2-4e67-9873-0ce0f852bd18 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received event network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4a5a150a-2b0c-4b07-82c2-2c205fca6414 req-4fb2e286-07b2-4e67-9873-0ce0f852bd18 service nova] Acquiring lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4a5a150a-2b0c-4b07-82c2-2c205fca6414 req-4fb2e286-07b2-4e67-9873-0ce0f852bd18 service nova] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4a5a150a-2b0c-4b07-82c2-2c205fca6414 req-4fb2e286-07b2-4e67-9873-0ce0f852bd18 service nova] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG nova.compute.manager [req-4a5a150a-2b0c-4b07-82c2-2c205fca6414 req-4fb2e286-07b2-4e67-9873-0ce0f852bd18 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] No waiting events found dispatching network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:56 user nova-compute[73052]: WARNING nova.compute.manager [req-4a5a150a-2b0c-4b07-82c2-2c205fca6414 req-4fb2e286-07b2-4e67-9873-0ce0f852bd18 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received unexpected event network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 for instance with vm_state building and task_state spawning.
Aug 26 14:53:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061638.8283195, 75b47e02-ff4b-4c57-93d3-4bca7eacc737 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:53:58 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] VM Resumed (Lifecycle Event)
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:53:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Instance spawned successfully.
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:53:58 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061638.8333373, 75b47e02-ff4b-4c57-93d3-4bca7eacc737 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:53:58 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] VM Started (Lifecycle Event)
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:53:58 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:53:58 user nova-compute[73052]: INFO nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 26 14:53:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:53:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-8feaf0aa-fb69-4fb0-ae73-4864aeab3fec req-dfe7ba2a-3ee2-4818-a6aa-0bf44d9c3b2d service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received event network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:53:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8feaf0aa-fb69-4fb0-ae73-4864aeab3fec req-dfe7ba2a-3ee2-4818-a6aa-0bf44d9c3b2d service nova] Acquiring lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:53:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8feaf0aa-fb69-4fb0-ae73-4864aeab3fec req-dfe7ba2a-3ee2-4818-a6aa-0bf44d9c3b2d service nova] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:53:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8feaf0aa-fb69-4fb0-ae73-4864aeab3fec req-dfe7ba2a-3ee2-4818-a6aa-0bf44d9c3b2d service nova] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-8feaf0aa-fb69-4fb0-ae73-4864aeab3fec req-dfe7ba2a-3ee2-4818-a6aa-0bf44d9c3b2d service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] No waiting events found dispatching network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:53:59 user nova-compute[73052]: WARNING nova.compute.manager [req-8feaf0aa-fb69-4fb0-ae73-4864aeab3fec req-dfe7ba2a-3ee2-4818-a6aa-0bf44d9c3b2d service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received unexpected event network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 for instance with vm_state building and task_state spawning.
Aug 26 14:53:59 user nova-compute[73052]: INFO nova.compute.manager [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Took 24.53 seconds to build instance.
Aug 26 14:53:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b107aaf7-101b-4131-9a38-13cb344b6632 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.630s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:53:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:54:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:54:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:54:04 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:54:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [{"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:05 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061630.9050226, 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:54:05 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] VM Stopped (Lifecycle Event)
Aug 26 14:54:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-682d74ba-5638-4d9d-81f8-aa37094b01a0 None None] [instance: 8c5ecea5-aa8d-4743-9109-cab8a5e81e2d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:54:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:10 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:54:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:54:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:14 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:54:14 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7145MB free_disk=25.235065460205078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7acb8d8e-f559-412c-91b3-e20f2df2a09a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4a1dd457-797c-45b6-bc73-c6c5276acacb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d8fbdddb-dece-4881-bf03-96040e3c731d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 75b47e02-ff4b-4c57-93d3-4bca7eacc737 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:54:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:15 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:54:15 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:54:15 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:54:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG nova.objects.instance [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'flavor' on Instance uuid de3630fa-98b3-4a5a-b008-e98f0c72d0ea {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:33 user nova-compute[73052]: INFO nova.compute.manager [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Attaching volume 46e100e0-13e7-408e-a948-049ebfa88076 to /dev/vdb
Aug 26 14:54:33 user nova-compute[73052]: DEBUG os_brick.utils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1369b6a3-fe79-42a9-abda-d3c344031cfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ad1f9-3f20-4852-86cb-16df8a004631]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e4a74-eea6-4d7e-b6a8-7aee181e4bbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b123a-f41b-49b5-8ecf-345eb777ad11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:54:33 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:54:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[70073aa0-a632-47ed-ab3c-6deb9f7ef721]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG os_brick.utils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:54:33 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating existing volume attachment record: 0da67a8a-4422-4004-bdcf-e0c4a6f258f3 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:54:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-295061f9-b9c9-43c8-b5ff-826e6feda4f1 req-0677cf2d-2473-4c65-aa83-1db36a2141f9 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-changed-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-295061f9-b9c9-43c8-b5ff-826e6feda4f1 req-0677cf2d-2473-4c65-aa83-1db36a2141f9 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Refreshing instance network info cache due to event network-changed-d42c2dcf-f8f8-4178-a32b-faea50050dcf. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:54:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-295061f9-b9c9-43c8-b5ff-826e6feda4f1 req-0677cf2d-2473-4c65-aa83-1db36a2141f9 service nova] Acquiring lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:54:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-295061f9-b9c9-43c8-b5ff-826e6feda4f1 req-0677cf2d-2473-4c65-aa83-1db36a2141f9 service nova] Acquired lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:54:38 user nova-compute[73052]: DEBUG nova.network.neutron [req-295061f9-b9c9-43c8-b5ff-826e6feda4f1 req-0677cf2d-2473-4c65-aa83-1db36a2141f9 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Refreshing network info cache for port d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:39 user nova-compute[73052]: INFO nova.compute.manager [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Detaching volume 6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-295061f9-b9c9-43c8-b5ff-826e6feda4f1 req-0677cf2d-2473-4c65-aa83-1db36a2141f9 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updated VIF entry in instance network info cache for port d42c2dcf-f8f8-4178-a32b-faea50050dcf. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.network.neutron [req-295061f9-b9c9-43c8-b5ff-826e6feda4f1 req-0677cf2d-2473-4c65-aa83-1db36a2141f9 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:39 user nova-compute[73052]: INFO nova.virt.block_device [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Attempting to driver detach volume 6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 from mountpoint /dev/vdb
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-295061f9-b9c9-43c8-b5ff-826e6feda4f1 req-0677cf2d-2473-4c65-aa83-1db36a2141f9 service nova] Releasing lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Attempting to detach device vdb from instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:54:39 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:54:39 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:54:39 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:54:39 user nova-compute[73052]:   <serial>6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0</serial>
Aug 26 14:54:39 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:54:39 user nova-compute[73052]: </disk>
Aug 26 14:54:39 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:54:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Successfully detached device vdb from instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 from the persistent domain config.
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:54:39 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:54:39 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:54:39 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:54:39 user nova-compute[73052]:   <serial>6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0</serial>
Aug 26 14:54:39 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:54:39 user nova-compute[73052]: </disk>
Aug 26 14:54:39 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061679.7751057, 2b3a3e44-b6be-4d68-b034-843d74ba9334 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:54:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Successfully detached device vdb from instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 from the live domain config.
Aug 26 14:54:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neKokTcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:54:39 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6fd6af-9a91-4d7a-916f-3f0aef407ee7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[147c8ca0-c012-45d4-bf0a-ae02ff48769b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:54:39 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:54:39 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:54:39 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0189fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfabf2a-0fe5-4a26-ab30-fbd312b179a6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[37220476-c422-4019-8d90-0644e0404c45]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb30de35-f5c7-464b-a8b9-8b57bc6b3439]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[128d5ce8-1bbb-4bb1-ac01-c19e5efb0228]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:54:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4eea35-e849-49d1-9383-cca316421c8b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff9ae0-893e-4d6b-96a4-3e19d377ed79]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0, portal: 172.16.0.220,3260]
Aug 26 14:54:40 user nova-compute[73052]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0, portal: 172.16.0.220,3260] successful.
Aug 26 14:54:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6da3f6-c45e-487c-b5b5-de8bae2fb2e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b87060-e266-4e9e-99f5-44e5450e1023]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] <== disconnect_volume: return (337ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-bd90476c-cee5-4442-879c-996c35895c6b req-a3770c2f-41f4-497a-94a8-790d42bce2c2 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-changed-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-bd90476c-cee5-4442-879c-996c35895c6b req-a3770c2f-41f4-497a-94a8-790d42bce2c2 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Refreshing instance network info cache due to event network-changed-d42c2dcf-f8f8-4178-a32b-faea50050dcf. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bd90476c-cee5-4442-879c-996c35895c6b req-a3770c2f-41f4-497a-94a8-790d42bce2c2 service nova] Acquiring lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bd90476c-cee5-4442-879c-996c35895c6b req-a3770c2f-41f4-497a-94a8-790d42bce2c2 service nova] Acquired lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:54:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-bd90476c-cee5-4442-879c-996c35895c6b req-a3770c2f-41f4-497a-94a8-790d42bce2c2 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Refreshing network info cache for port d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:54:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'flavor' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:54:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-407978c9-efb6-4db3-9f97-c17af47a9705 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.876s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-bd90476c-cee5-4442-879c-996c35895c6b req-a3770c2f-41f4-497a-94a8-790d42bce2c2 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updated VIF entry in instance network info cache for port d42c2dcf-f8f8-4178-a32b-faea50050dcf. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:54:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-bd90476c-cee5-4442-879c-996c35895c6b req-a3770c2f-41f4-497a-94a8-790d42bce2c2 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bd90476c-cee5-4442-879c-996c35895c6b req-a3770c2f-41f4-497a-94a8-790d42bce2c2 service nova] Releasing lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:54:42 user nova-compute[73052]: INFO nova.compute.claims [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Claim successful on node user
Aug 26 14:54:42 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:54:42 user nova-compute[73052]: DEBUG nova.network.neutron [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:54:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:54:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG nova.policy [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed5225f2064f43e893a054c3583a0b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1afa5dd9c74414a874e103410b71be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:54:43 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Creating image(s)
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "/opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "/opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "/opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk 1073741824" returned: 0 in 0.068s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG nova.network.neutron [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Successfully created port: ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.209s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:54:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Cannot resize image /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Ensure instance console log exists: /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG nova.network.neutron [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Successfully updated port: ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "refresh_cache-e709cd6a-f799-4b23-af84-436bc8d7f0a1" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquired lock "refresh_cache-e709cd6a-f799-4b23-af84-436bc8d7f0a1" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG nova.network.neutron [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-28d7918b-ef71-4981-8897-ee650497d6a4 req-12a32aeb-33ec-4979-8244-2e8e72463b5b service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received event network-changed-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-28d7918b-ef71-4981-8897-ee650497d6a4 req-12a32aeb-33ec-4979-8244-2e8e72463b5b service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Refreshing instance network info cache due to event network-changed-ef36f027-87a4-43f8-a155-ed227963e764. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-28d7918b-ef71-4981-8897-ee650497d6a4 req-12a32aeb-33ec-4979-8244-2e8e72463b5b service nova] Acquiring lock "refresh_cache-e709cd6a-f799-4b23-af84-436bc8d7f0a1" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:54:44 user nova-compute[73052]: DEBUG nova.network.neutron [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.network.neutron [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Updating instance_info_cache with network_info: [{"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Releasing lock "refresh_cache-e709cd6a-f799-4b23-af84-436bc8d7f0a1" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Instance network_info: |[{"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-28d7918b-ef71-4981-8897-ee650497d6a4 req-12a32aeb-33ec-4979-8244-2e8e72463b5b service nova] Acquired lock "refresh_cache-e709cd6a-f799-4b23-af84-436bc8d7f0a1" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.network.neutron [req-28d7918b-ef71-4981-8897-ee650497d6a4 req-12a32aeb-33ec-4979-8244-2e8e72463b5b service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Refreshing network info cache for port ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Start _get_guest_xml network_info=[{"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:54:45 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:54:45 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1700584714',display_name='tempest-VolumesActionsTest-instance-1700584714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1700584714',id=31,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c1afa5dd9c74414a874e103410b71be',ramdisk_id='',reservation_id='r-50myqzny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775568266',owner_user_name='tempest-VolumesActionsTest-1775568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:54:43Z,user_data=None,user_id='ed5225f2064f43e893a054c3583a0b8f',uuid=e709cd6a-f799-4b23-af84-436bc8d7f0a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converting VIF {"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:e6:ce,bridge_name='br-int',has_traffic_filtering=True,id=ef36f027-87a4-43f8-a155-ed227963e764,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef36f027-87') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lazy-loading 'pci_devices' on Instance uuid e709cd6a-f799-4b23-af84-436bc8d7f0a1 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:54:45 user nova-compute[73052]:   <uuid>e709cd6a-f799-4b23-af84-436bc8d7f0a1</uuid>
Aug 26 14:54:45 user nova-compute[73052]:   <name>instance-0000001f</name>
Aug 26 14:54:45 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:54:45 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:54:45 user nova-compute[73052]:   <metadata>
Aug 26 14:54:45 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:54:45 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:54:45 user nova-compute[73052]:       <nova:name>tempest-VolumesActionsTest-instance-1700584714</nova:name>
Aug 26 14:54:45 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:54:45</nova:creationTime>
Aug 26 14:54:45 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:54:45 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:54:45 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:54:45 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:54:45 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:54:45 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:54:45 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:54:45 user nova-compute[73052]:       <nova:owner>
Aug 26 14:54:45 user nova-compute[73052]:         <nova:user uuid="ed5225f2064f43e893a054c3583a0b8f">tempest-VolumesActionsTest-1775568266-project-member</nova:user>
Aug 26 14:54:45 user nova-compute[73052]:         <nova:project uuid="3c1afa5dd9c74414a874e103410b71be">tempest-VolumesActionsTest-1775568266</nova:project>
Aug 26 14:54:45 user nova-compute[73052]:       </nova:owner>
Aug 26 14:54:45 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:54:45 user nova-compute[73052]:       <nova:ports>
Aug 26 14:54:45 user nova-compute[73052]:         <nova:port uuid="ef36f027-87a4-43f8-a155-ed227963e764">
Aug 26 14:54:45 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 14:54:45 user nova-compute[73052]:         </nova:port>
Aug 26 14:54:45 user nova-compute[73052]:       </nova:ports>
Aug 26 14:54:45 user nova-compute[73052]:     </nova:instance>
Aug 26 14:54:45 user nova-compute[73052]:   </metadata>
Aug 26 14:54:45 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:54:45 user nova-compute[73052]:     <system>
Aug 26 14:54:45 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:54:45 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:54:45 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:54:45 user nova-compute[73052]:       <entry name="serial">e709cd6a-f799-4b23-af84-436bc8d7f0a1</entry>
Aug 26 14:54:45 user nova-compute[73052]:       <entry name="uuid">e709cd6a-f799-4b23-af84-436bc8d7f0a1</entry>
Aug 26 14:54:45 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:54:45 user nova-compute[73052]:     </system>
Aug 26 14:54:45 user nova-compute[73052]:   </sysinfo>
Aug 26 14:54:45 user nova-compute[73052]:   <os>
Aug 26 14:54:45 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:54:45 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:54:45 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:54:45 user nova-compute[73052]:   </os>
Aug 26 14:54:45 user nova-compute[73052]:   <features>
Aug 26 14:54:45 user nova-compute[73052]:     <acpi/>
Aug 26 14:54:45 user nova-compute[73052]:     <apic/>
Aug 26 14:54:45 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:54:45 user nova-compute[73052]:   </features>
Aug 26 14:54:45 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:54:45 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:54:45 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:54:45 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:54:45 user nova-compute[73052]:   </clock>
Aug 26 14:54:45 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:54:45 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:54:45 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:54:45 user nova-compute[73052]:   </cpu>
Aug 26 14:54:45 user nova-compute[73052]:   <devices>
Aug 26 14:54:45 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:54:45 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:54:45 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk"/>
Aug 26 14:54:45 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:54:45 user nova-compute[73052]:     </disk>
Aug 26 14:54:45 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:54:45 user nova-compute[73052]:       <mac address="fa:16:3e:c9:e6:ce"/>
Aug 26 14:54:45 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:54:45 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:54:45 user nova-compute[73052]:       <target dev="tapef36f027-87"/>
Aug 26 14:54:45 user nova-compute[73052]:     </interface>
Aug 26 14:54:45 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:54:45 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/console.log" append="off"/>
Aug 26 14:54:45 user nova-compute[73052]:     </serial>
Aug 26 14:54:45 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:54:45 user nova-compute[73052]:     <video>
Aug 26 14:54:45 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:54:45 user nova-compute[73052]:     </video>
Aug 26 14:54:45 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:54:45 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:54:45 user nova-compute[73052]:     </rng>
Aug 26 14:54:45 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:54:45 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:54:45 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:54:45 user nova-compute[73052]:     </memballoon>
Aug 26 14:54:45 user nova-compute[73052]:   </devices>
Aug 26 14:54:45 user nova-compute[73052]: </domain>
Aug 26 14:54:45 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1700584714',display_name='tempest-VolumesActionsTest-instance-1700584714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1700584714',id=31,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c1afa5dd9c74414a874e103410b71be',ramdisk_id='',reservation_id='r-50myqzny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775568266',owner_user_name='tempest-VolumesActionsTest-1775568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:54:43Z,user_data=None,user_id='ed5225f2064f43e893a054c3583a0b8f',uuid=e709cd6a-f799-4b23-af84-436bc8d7f0a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converting VIF {"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:e6:ce,bridge_name='br-int',has_traffic_filtering=True,id=ef36f027-87a4-43f8-a155-ed227963e764,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef36f027-87') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG os_vif [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:e6:ce,bridge_name='br-int',has_traffic_filtering=True,id=ef36f027-87a4-43f8-a155-ed227963e764,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef36f027-87') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef36f027-87, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef36f027-87, col_values=(('external_ids', {'iface-id': 'ef36f027-87a4-43f8-a155-ed227963e764', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:e6:ce', 'vm-uuid': 'e709cd6a-f799-4b23-af84-436bc8d7f0a1'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:45 user nova-compute[73052]: INFO os_vif [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:e6:ce,bridge_name='br-int',has_traffic_filtering=True,id=ef36f027-87a4-43f8-a155-ed227963e764,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef36f027-87')
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] No VIF found with MAC fa:16:3e:c9:e6:ce, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.network.neutron [req-28d7918b-ef71-4981-8897-ee650497d6a4 req-12a32aeb-33ec-4979-8244-2e8e72463b5b service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Updated VIF entry in instance network info cache for port ef36f027-87a4-43f8-a155-ed227963e764. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG nova.network.neutron [req-28d7918b-ef71-4981-8897-ee650497d6a4 req-12a32aeb-33ec-4979-8244-2e8e72463b5b service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Updating instance_info_cache with network_info: [{"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-28d7918b-ef71-4981-8897-ee650497d6a4 req-12a32aeb-33ec-4979-8244-2e8e72463b5b service nova] Releasing lock "refresh_cache-e709cd6a-f799-4b23-af84-436bc8d7f0a1" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpyTZnog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:54:46 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:54:46 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:54:46 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253442d-0f6c-434a-8f88-f9d460f41bcf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:54:46 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbf8e66-026a-4eda-b3ee-c3a631530b6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076] added
Aug 26 14:54:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b36f4-36f6-46f9-8817-0d877aac7be9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8b7857-bff5-440c-9ca4-7f206b91e410]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpyTZnog {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpyTZnog" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5a4538-dfc8-4cc2-a6e4-81421e7860fc]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RpyTZnog'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5574b81-8017-4542-8019-e7565bbd6268]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[00353f4e-6f25-46d9-9c7e-74cef3738a6a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:54:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:54:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8113f8a-51d3-4f82-903f-e9615f2df1d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076, portal: 172.16.0.220,3260]
Aug 26 14:54:46 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076, portal: 172.16.0.220,3260] successful.
Aug 26 14:54:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0186f4-7a4a-43cc-8dc0-662b9d13ff89]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6791e2cd-57ff-4131-a362-999d2aa82c60]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:54:46 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:54:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4735e263-ed0d-4898-8a2e-bcbddb77b771]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:54:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpyTZnog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-db96ff08-b907-4976-8e34-d13ebe6be069 req-b8aeffff-c582-45b0-b491-257ecb35fe78 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received event network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db96ff08-b907-4976-8e34-d13ebe6be069 req-b8aeffff-c582-45b0-b491-257ecb35fe78 service nova] Acquiring lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db96ff08-b907-4976-8e34-d13ebe6be069 req-b8aeffff-c582-45b0-b491-257ecb35fe78 service nova] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db96ff08-b907-4976-8e34-d13ebe6be069 req-b8aeffff-c582-45b0-b491-257ecb35fe78 service nova] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-db96ff08-b907-4976-8e34-d13ebe6be069 req-b8aeffff-c582-45b0-b491-257ecb35fe78 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] No waiting events found dispatching network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:54:47 user nova-compute[73052]: WARNING nova.compute.manager [req-db96ff08-b907-4976-8e34-d13ebe6be069 req-b8aeffff-c582-45b0-b491-257ecb35fe78 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received unexpected event network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 for instance with vm_state building and task_state spawning.
Aug 26 14:54:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23063336362316661', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063336362316661', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG nova.objects.instance [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'flavor' on Instance uuid de3630fa-98b3-4a5a-b008-e98f0c72d0ea {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:54:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:54:47 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:54:47 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:54:47 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:54:47 user nova-compute[73052]:   <serial>46e100e0-13e7-408e-a948-049ebfa88076</serial>
Aug 26 14:54:47 user nova-compute[73052]: </disk>
Aug 26 14:54:47 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:54:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:54:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:54:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] No VIF found with MAC fa:16:3e:41:a9:f3, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:54:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-30e98da6-c339-450f-a20d-27cc2b654017 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.234s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:49 user nova-compute[73052]: INFO nova.compute.manager [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Terminating instance
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061689.4002578, e709cd6a-f799-4b23-af84-436bc8d7f0a1 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:54:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] VM Resumed (Lifecycle Event)
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:54:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Instance spawned successfully.
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-fbd4348d-8600-4ca9-b39d-1b3ea4ae2430 req-8f6b3d28-d15a-497d-87eb-fffbcdd12c59 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received event network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fbd4348d-8600-4ca9-b39d-1b3ea4ae2430 req-8f6b3d28-d15a-497d-87eb-fffbcdd12c59 service nova] Acquiring lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fbd4348d-8600-4ca9-b39d-1b3ea4ae2430 req-8f6b3d28-d15a-497d-87eb-fffbcdd12c59 service nova] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fbd4348d-8600-4ca9-b39d-1b3ea4ae2430 req-8f6b3d28-d15a-497d-87eb-fffbcdd12c59 service nova] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-fbd4348d-8600-4ca9-b39d-1b3ea4ae2430 req-8f6b3d28-d15a-497d-87eb-fffbcdd12c59 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] No waiting events found dispatching network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:54:49 user nova-compute[73052]: WARNING nova.compute.manager [req-fbd4348d-8600-4ca9-b39d-1b3ea4ae2430 req-8f6b3d28-d15a-497d-87eb-fffbcdd12c59 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received unexpected event network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 for instance with vm_state building and task_state spawning.
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061689.4024098, e709cd6a-f799-4b23-af84-436bc8d7f0a1 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:54:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] VM Started (Lifecycle Event)
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:54:49 user nova-compute[73052]: INFO nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:54:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:49 user nova-compute[73052]: INFO nova.compute.manager [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Took 7.21 seconds to build instance.
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-115ae517-3bf4-4b70-baba-6955a635e960 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.317s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-717862c5-f6bd-42d9-a596-183bb5bb87c2 req-34d5aa5c-0158-4553-a2f6-446f038a25d8 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-717862c5-f6bd-42d9-a596-183bb5bb87c2 req-34d5aa5c-0158-4553-a2f6-446f038a25d8 service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-717862c5-f6bd-42d9-a596-183bb5bb87c2 req-34d5aa5c-0158-4553-a2f6-446f038a25d8 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-717862c5-f6bd-42d9-a596-183bb5bb87c2 req-34d5aa5c-0158-4553-a2f6-446f038a25d8 service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-717862c5-f6bd-42d9-a596-183bb5bb87c2 req-34d5aa5c-0158-4553-a2f6-446f038a25d8 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-717862c5-f6bd-42d9-a596-183bb5bb87c2 req-34d5aa5c-0158-4553-a2f6-446f038a25d8 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-unplugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:54:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Instance destroyed successfully.
Aug 26 14:54:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lazy-loading 'resources' on Instance uuid 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900953138',display_name='tempest-ServerActionsTestOtherB-server-900953138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900953138',id=17,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG5leR7tzdYKIpfV7Ec9kf768h0hGUNBTronYYTCV1PcoENaiBJlARfMP9HYEtnLsD4YAql1og50LfOPfw1/yQWyCBr98loRegNKK0hJEc77I3QM8SNTXRT/1aUwr2x0g==',key_name='tempest-keypair-1794046477',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:52:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbc99e80f5340d0ab8b4c7fe2d0a0c1',ramdisk_id='',reservation_id='r-2fzwidyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-135111462',owner_user_name='tempest-ServerActionsTestOtherB-135111462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:52:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb9db00a77d444f791cccb1be3d9150c',uuid=3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converting VIF {"id": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "address": "fa:16:3e:5d:9d:ed", "network": {"id": "c138eacd-bf4c-44eb-b85d-8b4be1ea408c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1401820556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbc99e80f5340d0ab8b4c7fe2d0a0c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd15d9bd-b8", "ovs_interfaceid": "fd15d9bd-b847-4224-8279-fa3bbb3958b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_vif [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd15d9bd-b8, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:50 user nova-compute[73052]: INFO os_vif [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=fd15d9bd-b847-4224-8279-fa3bbb3958b9,network=Network(c138eacd-bf4c-44eb-b85d-8b4be1ea408c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd15d9bd-b8')
Aug 26 14:54:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfzBVdZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:54:50 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27553d5-1d3d-4821-9fed-bb27f0c397e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0152ba9d-f82b-445f-9d09-450130cd7ec8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:54:50 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:54:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a018bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[84734f33-2627-4289-a1ca-34c3c73dfa91]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f8d31-bd67-4c73-b69a-f6f4c6ead1aa]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefdeab3-d5ed-4bd7-8838-9f8d49328cba]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dabc756-f7a9-4072-b061-697218c2122e]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf086a27-f909-4f7e-a1a5-b82cdb00ebd9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd8086-dd52-4486-a21f-a596daf3a980]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260]
Aug 26 14:54:50 user nova-compute[73052]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280, portal: 172.16.0.220,3260] successful.
Aug 26 14:54:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe931b3-9a09-4e00-b36d-bbcf1b77e280 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be1f1f3-f66c-4ae7-8b59-c342fb582c92]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] <== disconnect_volume: return (389ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:54:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Deleting instance files /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6_del
Aug 26 14:54:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Deletion of /opt/stack/data/nova/instances/3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6_del complete
Aug 26 14:54:50 user nova-compute[73052]: INFO nova.compute.manager [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 26 14:54:50 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:54:50 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:54:51 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:51 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Took 1.03 seconds to deallocate network for instance.
Aug 26 14:54:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-f3a91a13-29ba-4632-bbf9-556bbcf12a4d req-b6043730-6249-422c-bacb-0ac171285785 service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-deleted-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-067b9dc5-1988-4991-bc4c-9c8bf5935c3d req-af30dd68-7001-411e-9bbf-cc40d12c57fd service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-067b9dc5-1988-4991-bc4c-9c8bf5935c3d req-af30dd68-7001-411e-9bbf-cc40d12c57fd service nova] Acquiring lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-067b9dc5-1988-4991-bc4c-9c8bf5935c3d req-af30dd68-7001-411e-9bbf-cc40d12c57fd service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-067b9dc5-1988-4991-bc4c-9c8bf5935c3d req-af30dd68-7001-411e-9bbf-cc40d12c57fd service nova] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-067b9dc5-1988-4991-bc4c-9c8bf5935c3d req-af30dd68-7001-411e-9bbf-cc40d12c57fd service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] No waiting events found dispatching network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:54:51 user nova-compute[73052]: WARNING nova.compute.manager [req-067b9dc5-1988-4991-bc4c-9c8bf5935c3d req-af30dd68-7001-411e-9bbf-cc40d12c57fd service nova] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Received unexpected event network-vif-plugged-fd15d9bd-b847-4224-8279-fa3bbb3958b9 for instance with vm_state active and task_state deleting.
Aug 26 14:54:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-4ebf0e53-0185-416e-84cb-957b33ac56fe req-07bc8205-f41c-44b1-91e1-bf811323ef97 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-4ebf0e53-0185-416e-84cb-957b33ac56fe req-07bc8205-f41c-44b1-91e1-bf811323ef97 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing instance network info cache due to event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:54:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4ebf0e53-0185-416e-84cb-957b33ac56fe req-07bc8205-f41c-44b1-91e1-bf811323ef97 service nova] Acquiring lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:54:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4ebf0e53-0185-416e-84cb-957b33ac56fe req-07bc8205-f41c-44b1-91e1-bf811323ef97 service nova] Acquired lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:54:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-4ebf0e53-0185-416e-84cb-957b33ac56fe req-07bc8205-f41c-44b1-91e1-bf811323ef97 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:54:52 user nova-compute[73052]: INFO nova.compute.manager [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Took 1.02 seconds to detach 1 volumes for instance.
Aug 26 14:54:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-4ebf0e53-0185-416e-84cb-957b33ac56fe req-07bc8205-f41c-44b1-91e1-bf811323ef97 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updated VIF entry in instance network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:54:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-4ebf0e53-0185-416e-84cb-957b33ac56fe req-07bc8205-f41c-44b1-91e1-bf811323ef97 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating instance_info_cache with network_info: [{"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4ebf0e53-0185-416e-84cb-957b33ac56fe req-07bc8205-f41c-44b1-91e1-bf811323ef97 service nova] Releasing lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:54:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:53 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:54:53 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:54:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:53 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Deleted allocations for instance 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6
Aug 26 14:54:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f9f95208-d58c-4aa9-8418-bb62e65c3c98 tempest-ServerActionsTestOtherB-135111462 tempest-ServerActionsTestOtherB-135111462-project-member] Lock "3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.173s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-f51d179c-fbaf-48f8-92de-b64dac2579a2 req-01c82718-1423-4b8e-b908-7b4cfd9b9c8e service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-f51d179c-fbaf-48f8-92de-b64dac2579a2 req-01c82718-1423-4b8e-b908-7b4cfd9b9c8e service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing instance network info cache due to event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:54:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f51d179c-fbaf-48f8-92de-b64dac2579a2 req-01c82718-1423-4b8e-b908-7b4cfd9b9c8e service nova] Acquiring lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:54:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f51d179c-fbaf-48f8-92de-b64dac2579a2 req-01c82718-1423-4b8e-b908-7b4cfd9b9c8e service nova] Acquired lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:54:54 user nova-compute[73052]: DEBUG nova.network.neutron [req-f51d179c-fbaf-48f8-92de-b64dac2579a2 req-01c82718-1423-4b8e-b908-7b4cfd9b9c8e service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:54:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:55 user nova-compute[73052]: DEBUG nova.network.neutron [req-f51d179c-fbaf-48f8-92de-b64dac2579a2 req-01c82718-1423-4b8e-b908-7b4cfd9b9c8e service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updated VIF entry in instance network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:54:55 user nova-compute[73052]: DEBUG nova.network.neutron [req-f51d179c-fbaf-48f8-92de-b64dac2579a2 req-01c82718-1423-4b8e-b908-7b4cfd9b9c8e service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating instance_info_cache with network_info: [{"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f51d179c-fbaf-48f8-92de-b64dac2579a2 req-01c82718-1423-4b8e-b908-7b4cfd9b9c8e service nova] Releasing lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:54:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:55 user nova-compute[73052]: INFO nova.compute.manager [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Rebooting instance
Aug 26 14:54:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:54:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquired lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:54:55 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:54:56 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating instance_info_cache with network_info: [{"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:54:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Releasing lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:54:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-cc153225-715e-46f7-a3a9-2dcda5e70404 req-f6fa2c21-28d9-4f2e-8637-d7a0930c0377 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-unplugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc153225-715e-46f7-a3a9-2dcda5e70404 req-f6fa2c21-28d9-4f2e-8637-d7a0930c0377 service nova] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc153225-715e-46f7-a3a9-2dcda5e70404 req-f6fa2c21-28d9-4f2e-8637-d7a0930c0377 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc153225-715e-46f7-a3a9-2dcda5e70404 req-f6fa2c21-28d9-4f2e-8637-d7a0930c0377 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:54:58 user nova-compute[73052]: DEBUG nova.compute.manager [req-cc153225-715e-46f7-a3a9-2dcda5e70404 req-f6fa2c21-28d9-4f2e-8637-d7a0930c0377 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] No waiting events found dispatching network-vif-unplugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:54:58 user nova-compute[73052]: WARNING nova.compute.manager [req-cc153225-715e-46f7-a3a9-2dcda5e70404 req-f6fa2c21-28d9-4f2e-8637-d7a0930c0377 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received unexpected event network-vif-unplugged-3fc35180-bc12-4f46-a612-6d51786c0780 for instance with vm_state active and task_state reboot_started.
Aug 26 14:54:59 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance shutdown successfully.
Aug 26 14:54:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:54:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:54:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-362b9056-7590-402c-8dda-bfb051d46ee3 req-60a2d21c-3fca-4952-a659-c56ec7f19847 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-362b9056-7590-402c-8dda-bfb051d46ee3 req-60a2d21c-3fca-4952-a659-c56ec7f19847 service nova] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-362b9056-7590-402c-8dda-bfb051d46ee3 req-60a2d21c-3fca-4952-a659-c56ec7f19847 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-362b9056-7590-402c-8dda-bfb051d46ee3 req-60a2d21c-3fca-4952-a659-c56ec7f19847 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-362b9056-7590-402c-8dda-bfb051d46ee3 req-60a2d21c-3fca-4952-a659-c56ec7f19847 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] No waiting events found dispatching network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:01 user nova-compute[73052]: WARNING nova.compute.manager [req-362b9056-7590-402c-8dda-bfb051d46ee3 req-60a2d21c-3fca-4952-a659-c56ec7f19847 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received unexpected event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 for instance with vm_state active and task_state reboot_started.
Aug 26 14:55:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:55:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] No waiting events found dispatching network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:03 user nova-compute[73052]: WARNING nova.compute.manager [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received unexpected event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 for instance with vm_state active and task_state reboot_started.
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] No waiting events found dispatching network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:03 user nova-compute[73052]: WARNING nova.compute.manager [req-b1064db1-895f-4398-9a70-16d9de318d84 req-e9fb2241-1ff9-4bb6-ba68-507b44c3d4a7 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received unexpected event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 for instance with vm_state active and task_state reboot_started.
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for de3630fa-98b3-4a5a-b008-e98f0c72d0ea due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061703.6146016, de3630fa-98b3-4a5a-b008-e98f0c72d0ea => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:03 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] VM Resumed (Lifecycle Event)
Aug 26 14:55:03 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance running successfully.
Aug 26 14:55:03 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance soft rebooted successfully.
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:55:03 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061703.6177309, de3630fa-98b3-4a5a-b008-e98f0c72d0ea => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:03 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] VM Started (Lifecycle Event)
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b5cce0e7-c5f2-4e9f-b7ed-0c2035da594d tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.018s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [{"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-2b3a3e44-b6be-4d68-b034-843d74ba9334" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:55:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:55:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:05 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061690.2348447, 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:05 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] VM Stopped (Lifecycle Event)
Aug 26 14:55:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c9368a18-db90-4007-a12a-9e23732d4649 None None] [instance: 3c82e36a-3f9c-42cc-a1f1-5d91385ad6a6] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:55:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:55:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:55:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:55:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-0e896678-7c55-48a3-9c11-43dbdc90ac5c req-95650219-8d6f-4a74-9b8d-8678ade4a8fd service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-changed-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-0e896678-7c55-48a3-9c11-43dbdc90ac5c req-95650219-8d6f-4a74-9b8d-8678ade4a8fd service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Refreshing instance network info cache due to event network-changed-770c3e91-7e2f-4dc9-9b6f-395dc26faf87. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:55:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0e896678-7c55-48a3-9c11-43dbdc90ac5c req-95650219-8d6f-4a74-9b8d-8678ade4a8fd service nova] Acquiring lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:55:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0e896678-7c55-48a3-9c11-43dbdc90ac5c req-95650219-8d6f-4a74-9b8d-8678ade4a8fd service nova] Acquired lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:55:07 user nova-compute[73052]: DEBUG nova.network.neutron [req-0e896678-7c55-48a3-9c11-43dbdc90ac5c req-95650219-8d6f-4a74-9b8d-8678ade4a8fd service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Refreshing network info cache for port 770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'flavor' on Instance uuid d8fbdddb-dece-4881-bf03-96040e3c731d {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:08 user nova-compute[73052]: INFO nova.compute.manager [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Attaching volume 80173a02-2f46-4208-8ac1-14747ee27b53 to /dev/vdb
Aug 26 14:55:08 user nova-compute[73052]: DEBUG os_brick.utils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG nova.network.neutron [req-0e896678-7c55-48a3-9c11-43dbdc90ac5c req-95650219-8d6f-4a74-9b8d-8678ade4a8fd service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updated VIF entry in instance network info cache for port 770c3e91-7e2f-4dc9-9b6f-395dc26faf87. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG nova.network.neutron [req-0e896678-7c55-48a3-9c11-43dbdc90ac5c req-95650219-8d6f-4a74-9b8d-8678ade4a8fd service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updating instance_info_cache with network_info: [{"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0e896678-7c55-48a3-9c11-43dbdc90ac5c req-95650219-8d6f-4a74-9b8d-8678ade4a8fd service nova] Releasing lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4307c4b1-c9fa-4356-abf7-5088e6e983d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[13304145-190d-404d-8ab9-5336076eb336]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a00087-80d5-4146-b0e8-dd06c01c413f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518f573-81b1-4ecc-abb2-1462ab8e9f6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:55:08 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:55:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a601e803-2466-4c32-87bc-5f5158f5be9c]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG os_brick.utils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:08 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updating existing volume attachment record: c0d1cddc-c094-42e1-a0f2-d2326ca125c3 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:55:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:55:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:55:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:55:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-6e4d22d0-b8f4-422d-aeba-d0c681a3861f req-a7bb0d7c-5e15-4cdd-91fe-db3d843e38cd service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-changed-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-6e4d22d0-b8f4-422d-aeba-d0c681a3861f req-a7bb0d7c-5e15-4cdd-91fe-db3d843e38cd service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing instance network info cache due to event network-changed-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e4d22d0-b8f4-422d-aeba-d0c681a3861f req-a7bb0d7c-5e15-4cdd-91fe-db3d843e38cd service nova] Acquiring lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e4d22d0-b8f4-422d-aeba-d0c681a3861f req-a7bb0d7c-5e15-4cdd-91fe-db3d843e38cd service nova] Acquired lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-6e4d22d0-b8f4-422d-aeba-d0c681a3861f req-a7bb0d7c-5e15-4cdd-91fe-db3d843e38cd service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Refreshing network info cache for port fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:55:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG nova.network.neutron [req-6e4d22d0-b8f4-422d-aeba-d0c681a3861f req-a7bb0d7c-5e15-4cdd-91fe-db3d843e38cd service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updated VIF entry in instance network info cache for port fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG nova.network.neutron [req-6e4d22d0-b8f4-422d-aeba-d0c681a3861f req-a7bb0d7c-5e15-4cdd-91fe-db3d843e38cd service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6e4d22d0-b8f4-422d-aeba-d0c681a3861f req-a7bb0d7c-5e15-4cdd-91fe-db3d843e38cd service nova] Releasing lock "refresh_cache-4a1dd457-797c-45b6-bc73-c6c5276acacb" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:17 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:55:17 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7354MB free_disk=25.221782684326172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 2b3a3e44-b6be-4d68-b034-843d74ba9334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7acb8d8e-f559-412c-91b3-e20f2df2a09a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4a1dd457-797c-45b6-bc73-c6c5276acacb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d8fbdddb-dece-4881-bf03-96040e3c731d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 75b47e02-ff4b-4c57-93d3-4bca7eacc737 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e709cd6a-f799-4b23-af84-436bc8d7f0a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:55:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:18 user nova-compute[73052]: INFO nova.compute.manager [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Terminating instance
Aug 26 14:55:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-135e446f-69fd-43f2-a5bf-f20a0e0a89ca req-4b8541a1-ee39-40be-9c31-8964b275be74 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-135e446f-69fd-43f2-a5bf-f20a0e0a89ca req-4b8541a1-ee39-40be-9c31-8964b275be74 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-135e446f-69fd-43f2-a5bf-f20a0e0a89ca req-4b8541a1-ee39-40be-9c31-8964b275be74 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-135e446f-69fd-43f2-a5bf-f20a0e0a89ca req-4b8541a1-ee39-40be-9c31-8964b275be74 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-135e446f-69fd-43f2-a5bf-f20a0e0a89ca req-4b8541a1-ee39-40be-9c31-8964b275be74 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-unplugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-135e446f-69fd-43f2-a5bf-f20a0e0a89ca req-4b8541a1-ee39-40be-9c31-8964b275be74 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-51439386-ec51-4794-a0e0-af728104ee86 req-6c47bd56-c1ad-4d56-aaf3-c2819355292e service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-51439386-ec51-4794-a0e0-af728104ee86 req-6c47bd56-c1ad-4d56-aaf3-c2819355292e service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-51439386-ec51-4794-a0e0-af728104ee86 req-6c47bd56-c1ad-4d56-aaf3-c2819355292e service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-51439386-ec51-4794-a0e0-af728104ee86 req-6c47bd56-c1ad-4d56-aaf3-c2819355292e service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-51439386-ec51-4794-a0e0-af728104ee86 req-6c47bd56-c1ad-4d56-aaf3-c2819355292e service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-unplugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-51439386-ec51-4794-a0e0-af728104ee86 req-6c47bd56-c1ad-4d56-aaf3-c2819355292e service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-fa08e5ad-21c9-4ca1-9611-a6a405c2db6b req-195cfc1d-eb7d-4086-b1af-459b9b75bdda service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fa08e5ad-21c9-4ca1-9611-a6a405c2db6b req-195cfc1d-eb7d-4086-b1af-459b9b75bdda service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fa08e5ad-21c9-4ca1-9611-a6a405c2db6b req-195cfc1d-eb7d-4086-b1af-459b9b75bdda service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fa08e5ad-21c9-4ca1-9611-a6a405c2db6b req-195cfc1d-eb7d-4086-b1af-459b9b75bdda service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-fa08e5ad-21c9-4ca1-9611-a6a405c2db6b req-195cfc1d-eb7d-4086-b1af-459b9b75bdda service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-unplugged-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-fa08e5ad-21c9-4ca1-9611-a6a405c2db6b req-195cfc1d-eb7d-4086-b1af-459b9b75bdda service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-93f8f206-6c7b-4e89-9172-363eb5dca4db for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Instance destroyed successfully.
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lazy-loading 'resources' on Instance uuid 4a1dd457-797c-45b6-bc73-c6c5276acacb {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:eb:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f,network=Network(12509040-b05f-4317-acb8-e6b7b6cbb001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb9c0fc-c9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:eb:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f,network=Network(12509040-b05f-4317-acb8-e6b7b6cbb001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb9c0fc-c9') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcb9c0fc-c9, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: INFO os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:eb:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f,network=Network(12509040-b05f-4317-acb8-e6b7b6cbb001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb9c0fc-c9')
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ab:47,bridge_name='br-int',has_traffic_filtering=True,id=ed152f00-04c7-4852-a2b8-e0e94a6e94ff,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped152f00-04') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ab:47,bridge_name='br-int',has_traffic_filtering=True,id=ed152f00-04c7-4852-a2b8-e0e94a6e94ff,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped152f00-04') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped152f00-04, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: INFO os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ab:47,bridge_name='br-int',has_traffic_filtering=True,id=ed152f00-04c7-4852-a2b8-e0e94a6e94ff,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped152f00-04')
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5d:09,bridge_name='br-int',has_traffic_filtering=True,id=a4827275-1e85-4b0f-a824-386860a5de8e,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4827275-1e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5d:09,bridge_name='br-int',has_traffic_filtering=True,id=a4827275-1e85-4b0f-a824-386860a5de8e,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4827275-1e') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4827275-1e, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: INFO os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5d:09,bridge_name='br-int',has_traffic_filtering=True,id=a4827275-1e85-4b0f-a824-386860a5de8e,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4827275-1e')
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "address": "fa:16:3e:a9:e6:5e", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8f206-6c", "ovs_interfaceid": "93f8f206-6c7b-4e89-9172-363eb5dca4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:5e,bridge_name='br-int',has_traffic_filtering=True,id=93f8f206-6c7b-4e89-9172-363eb5dca4db,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8f206-6c') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:5e,bridge_name='br-int',has_traffic_filtering=True,id=93f8f206-6c7b-4e89-9172-363eb5dca4db,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8f206-6c') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93f8f206-6c, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: INFO os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:5e,bridge_name='br-int',has_traffic_filtering=True,id=93f8f206-6c7b-4e89-9172-363eb5dca4db,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8f206-6c')
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=115baf9d-2558-4071-8b4c-71b1c34b9f35,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115baf9d-25') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=115baf9d-2558-4071-8b4c-71b1c34b9f35,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115baf9d-25') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap115baf9d-25, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: INFO os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=115baf9d-2558-4071-8b4c-71b1c34b9f35,network=Network(42b9826f-b275-463f-9431-5ffe0c3cca5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap115baf9d-25')
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:99:2d,bridge_name='br-int',has_traffic_filtering=True,id=69f52b6e-1f9b-4cc6-86d8-37a326ca0a58,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f52b6e-1f') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:99:2d,bridge_name='br-int',has_traffic_filtering=True,id=69f52b6e-1f9b-4cc6-86d8-37a326ca0a58,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f52b6e-1f') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69f52b6e-1f, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: INFO os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:99:2d,bridge_name='br-int',has_traffic_filtering=True,id=69f52b6e-1f9b-4cc6-86d8-37a326ca0a58,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f52b6e-1f')
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T14:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1890719496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1890719496',id=27,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnscR5yDAmnXyyBpNCji6HcwTHORFAJLkMbWz9ccQK4mu/ad4vDROZ4K/BN4XdDCk1ZKCzwdCnHD8vcravM/wTdPPUN3Xq3EUuIYZ82FSL6z3VpC40n3qtb/aVHWjNHeg==',key_name='tempest-keypair-668975656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca20bab8a7f946889bb2be94209c3c39',ramdisk_id='',reservation_id='r-0mwyvx8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1108680602',owner_user_name='tempest-TaggedBootDevicesTest-1108680602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6587b43004af49e8bafcfbbd9cd216f7',uuid=4a1dd457-797c-45b6-bc73-c6c5276acacb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converting VIF {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b8:0e,bridge_name='br-int',has_traffic_filtering=True,id=6c091ed1-30d3-4b40-985f-2db76f7b8862,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c091ed1-30') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b8:0e,bridge_name='br-int',has_traffic_filtering=True,id=6c091ed1-30d3-4b40-985f-2db76f7b8862,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c091ed1-30') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c091ed1-30, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:20 user nova-compute[73052]: INFO os_vif [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b8:0e,bridge_name='br-int',has_traffic_filtering=True,id=6c091ed1-30d3-4b40-985f-2db76f7b8862,network=Network(61639e6d-eaed-4502-a41e-617ecf84612f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c091ed1-30')
Aug 26 14:55:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxVAiwPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:20 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccd9217-2f01-43fe-928f-eecdcb477855]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2a754a-9972-4cf9-bf16-8dc13cd9c658]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:20 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:20 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:20 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e9f7e-643b-4f26-8f36-c7df7b85fff1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a15781b-0a89-451f-9c96-86981072d40a]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:55:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7e7f14-08af-4169-b519-99f4e9afc1c4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb20ad9-5612-4401-b923-ed2307993cb0]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:21 user nova-compute[73052]: WARNING nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f for instance with vm_state active and task_state deleting.
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-unplugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:21 user nova-compute[73052]: WARNING nova.compute.manager [req-c7490db7-7eef-4f42-a339-2cb97844b73d req-972c5477-5488-44c8-9d74-3b55ddfed959 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-ed152f00-04c7-4852-a2b8-e0e94a6e94ff for instance with vm_state active and task_state deleting.
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8781d53d-378d-4d8e-ba6e-806db32d7e15]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b5feb2-84e7-445a-8b4b-d0bb9800f0a1]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf, portal: 172.16.0.220,3260]
Aug 26 14:55:21 user nova-compute[73052]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf, portal: 172.16.0.220,3260] successful.
Aug 26 14:55:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b421b39-c751-436e-98ad-a20e76ad2ccf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bebfe36-8868-4e5e-bfd8-7c2f890ac916]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== disconnect_volume: return (385ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKkWUuvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:21 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c2830c-2ba6-4357-b415-85b1a9a7821d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5075dac3-c266-4dea-9750-decad5b0a526]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a055b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736'): ({'sdf'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Removing single pathed devices sdf {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb7a31-a641-490e-a5a7-8d9741f8791f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9028a9c8-0c90-4eec-9024-b383a9fc1c89]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Flushing IO for device /dev/sdf {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4e9ec0-8e05-453c-89b5-9e5852f22b43]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf684ba-2370-46d2-9ad6-c63acab7f77f]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] SCSI volumes sdf have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[741697bb-fb82-4567-a381-6be511af7d6a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb42e73-91f8-44a9-a226-0651146d73c6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736, portal: 172.16.0.220,3260]
Aug 26 14:55:21 user nova-compute[73052]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736, portal: 172.16.0.220,3260] successful.
Aug 26 14:55:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5347c5-fa97-45fa-9c9f-59da2afc1736 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[607de1e9-2964-47f8-b579-272591cbe7f6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== disconnect_volume: return (305ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lerLHDRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:21 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ddc44b-5584-43d6-ae28-0e8f152129b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1c66cf-9512-4c65-8286-1bd510c5c427]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:21 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0185870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444'): ({'sdg'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Removing single pathed devices sdg {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[713681ad-5633-458b-864b-e186a12f20ad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f78f652-e007-4518-935b-2f2856c5e552]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Flushing IO for device /dev/sdg {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e11d75b-9acd-4b62-a269-934e8819dfd1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[52294266-6a52-4d1b-adca-a4686dd84eaa]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] SCSI volumes sdg have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-860f81a3-fd59-482e-b785-8b4963350858 req-0b0ef406-3dc9-4dfc-809e-62a6cad9d603 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-860f81a3-fd59-482e-b785-8b4963350858 req-0b0ef406-3dc9-4dfc-809e-62a6cad9d603 service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-860f81a3-fd59-482e-b785-8b4963350858 req-0b0ef406-3dc9-4dfc-809e-62a6cad9d603 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-860f81a3-fd59-482e-b785-8b4963350858 req-0b0ef406-3dc9-4dfc-809e-62a6cad9d603 service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-860f81a3-fd59-482e-b785-8b4963350858 req-0b0ef406-3dc9-4dfc-809e-62a6cad9d603 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:21 user nova-compute[73052]: WARNING nova.compute.manager [req-860f81a3-fd59-482e-b785-8b4963350858 req-0b0ef406-3dc9-4dfc-809e-62a6cad9d603 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 for instance with vm_state active and task_state deleting.
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8856a62f-47a2-49fe-972a-da5e759bd3b9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17690af-60da-4ac6-a87e-1dca54adf1d3]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444, portal: 172.16.0.220,3260]
Aug 26 14:55:21 user nova-compute[73052]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444, portal: 172.16.0.220,3260] successful.
Aug 26 14:55:21 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9726a27-13f2-44e8-8d48-ea28449e4444 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c16b98-4227-4b47-b41b-862a71edc992]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] <== disconnect_volume: return (312ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:55:21 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Deleting instance files /opt/stack/data/nova/instances/4a1dd457-797c-45b6-bc73-c6c5276acacb_del
Aug 26 14:55:21 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Deletion of /opt/stack/data/nova/instances/4a1dd457-797c-45b6-bc73-c6c5276acacb_del complete
Aug 26 14:55:21 user nova-compute[73052]: INFO nova.compute.manager [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Took 3.41 seconds to destroy the instance on the hypervisor.
Aug 26 14:55:21 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:55:21 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:22 user nova-compute[73052]: WARNING nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-93f8f206-6c7b-4e89-9172-363eb5dca4db for instance with vm_state active and task_state deleting.
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-unplugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:22 user nova-compute[73052]: WARNING nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-115baf9d-2558-4071-8b4c-71b1c34b9f35 for instance with vm_state active and task_state deleting.
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-unplugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-unplugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Acquiring lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] No waiting events found dispatching network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:22 user nova-compute[73052]: WARNING nova.compute.manager [req-bde88595-f194-41eb-a2c9-b1f63e7c9df2 req-df853f27-c71d-442b-ae64-596b264fd39c service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received unexpected event network-vif-plugged-6c091ed1-30d3-4b40-985f-2db76f7b8862 for instance with vm_state active and task_state deleting.
Aug 26 14:55:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZWXesYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:22 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:22 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:22 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0983d441-307d-47fc-9c3a-201f065ab792]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:55:22 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc3262e-82f7-4cd1-bab2-2d16fe9ffc0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53] added
Aug 26 14:55:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465cc88-99f9-476b-ad1d-6d4b6e671f20]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f984cc0-f770-459b-bd38-e1c38287cdfb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZWXesYp {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZWXesYp" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[942823ea-7902-4829-b974-9254cf60debf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZWXesYp'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1765e356-db01-4032-b375-d1fe71dc8af9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce42b7d4-3452-4f0f-82c8-4215243ff6ac]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:22 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:22 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:22 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:22 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cefc4c-b403-4665-ae80-ab941d986f96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260]
Aug 26 14:55:22 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260] successful.
Aug 26 14:55:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec26f07-c437-4958-ad22-2dd14cc66e82]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc3f289-5b43-4791-8c0f-76c0f85ece94]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:23 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:23 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:23 user nova-compute[73052]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:55:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:23 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:23 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:23 user nova-compute[73052]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:55:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[811e336c-6810-44eb-afdb-e1d401dac8a3]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:55:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZWXesYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23234646462643666', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234646462643666', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'flavor' on Instance uuid d8fbdddb-dece-4881-bf03-96040e3c731d {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:55:24 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:55:24 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:55:24 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:55:24 user nova-compute[73052]:   <serial>80173a02-2f46-4208-8ac1-14747ee27b53</serial>
Aug 26 14:55:24 user nova-compute[73052]: </disk>
Aug 26 14:55:24 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f705a15-4346-4a8b-840d-7a1e2cefd46a req-e51b593d-abb8-4017-b940-a5d09aa4a2b8 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-deleted-93f8f206-6c7b-4e89-9172-363eb5dca4db {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:24 user nova-compute[73052]: INFO nova.compute.manager [req-7f705a15-4346-4a8b-840d-7a1e2cefd46a req-e51b593d-abb8-4017-b940-a5d09aa4a2b8 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Neutron deleted interface 93f8f206-6c7b-4e89-9172-363eb5dca4db; detaching it from the instance and deleting it from the info cache
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.network.neutron [req-7f705a15-4346-4a8b-840d-7a1e2cefd46a req-e51b593d-abb8-4017-b940-a5d09aa4a2b8 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "address": "fa:16:3e:7c:99:2d", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f52b6e-1f", "ovs_interfaceid": "69f52b6e-1f9b-4cc6-86d8-37a326ca0a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f705a15-4346-4a8b-840d-7a1e2cefd46a req-e51b593d-abb8-4017-b940-a5d09aa4a2b8 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Detach interface failed, port_id=93f8f206-6c7b-4e89-9172-363eb5dca4db, reason: Instance 4a1dd457-797c-45b6-bc73-c6c5276acacb could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No VIF found with MAC fa:16:3e:22:ab:2e, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:55:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e85fe1f7-ff7a-46c6-8411-089f3532359d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.093s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:25 user nova-compute[73052]: INFO nova.compute.manager [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Rebuilding instance
Aug 26 14:55:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-deleted-69f52b6e-1f9b-4cc6-86d8-37a326ca0a58 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:26 user nova-compute[73052]: INFO nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Neutron deleted interface 69f52b6e-1f9b-4cc6-86d8-37a326ca0a58; detaching it from the instance and deleting it from the info cache
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.network.neutron [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "address": "fa:16:3e:66:d3:45", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap115baf9d-25", "ovs_interfaceid": "115baf9d-2558-4071-8b4c-71b1c34b9f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Detach interface failed, port_id=69f52b6e-1f9b-4cc6-86d8-37a326ca0a58, reason: Instance 4a1dd457-797c-45b6-bc73-c6c5276acacb could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-deleted-115baf9d-2558-4071-8b4c-71b1c34b9f35 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:26 user nova-compute[73052]: INFO nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Neutron deleted interface 115baf9d-2558-4071-8b4c-71b1c34b9f35; detaching it from the instance and deleting it from the info cache
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.network.neutron [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "address": "fa:16:3e:13:eb:8d", "network": {"id": "12509040-b05f-4317-acb8-e6b7b6cbb001", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1740571838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb9c0fc-c9", "ovs_interfaceid": "fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Detach interface failed, port_id=115baf9d-2558-4071-8b4c-71b1c34b9f35, reason: Instance 4a1dd457-797c-45b6-bc73-c6c5276acacb could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-deleted-fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:26 user nova-compute[73052]: INFO nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Neutron deleted interface fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f; detaching it from the instance and deleting it from the info cache
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.network.neutron [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [{"id": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "address": "fa:16:3e:d2:ab:47", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped152f00-04", "ovs_interfaceid": "ed152f00-04c7-4852-a2b8-e0e94a6e94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4827275-1e85-4b0f-a824-386860a5de8e", "address": "fa:16:3e:61:5d:09", "network": {"id": "42b9826f-b275-463f-9431-5ffe0c3cca5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-424369551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4827275-1e", "ovs_interfaceid": "a4827275-1e85-4b0f-a824-386860a5de8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "address": "fa:16:3e:f6:b8:0e", "network": {"id": "61639e6d-eaed-4502-a41e-617ecf84612f", "bridge": "br-int", "label": "tempest-device-tagging-net2-694928578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca20bab8a7f946889bb2be94209c3c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c091ed1-30", "ovs_interfaceid": "6c091ed1-30d3-4b40-985f-2db76f7b8862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-8f427ae4-1696-46ac-901e-aafb6aa41626 req-80483311-1f8e-40df-9f0e-80f08ea301f1 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received event network-changed-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-8f427ae4-1696-46ac-901e-aafb6aa41626 req-80483311-1f8e-40df-9f0e-80f08ea301f1 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Refreshing instance network info cache due to event network-changed-93bd7100-3306-44b9-b79a-7f693b42fd50. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8f427ae4-1696-46ac-901e-aafb6aa41626 req-80483311-1f8e-40df-9f0e-80f08ea301f1 service nova] Acquiring lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8f427ae4-1696-46ac-901e-aafb6aa41626 req-80483311-1f8e-40df-9f0e-80f08ea301f1 service nova] Acquired lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.network.neutron [req-8f427ae4-1696-46ac-901e-aafb6aa41626 req-80483311-1f8e-40df-9f0e-80f08ea301f1 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Refreshing network info cache for port 93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-45e67dbc-7d6c-4459-aa22-2b7b43e65ae6 req-10e919b6-ec29-4281-b7e9-21fca028b4e1 service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Detach interface failed, port_id=fcb9c0fc-c9ab-403f-ba77-c07902cc1f2f, reason: Instance 4a1dd457-797c-45b6-bc73-c6c5276acacb could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-2f3765a6-082d-4c28-8f4d-94fe56e73c97 req-b5f3a36c-f04e-4245-83a5-e2af97dd3ad1 service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-unplugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2f3765a6-082d-4c28-8f4d-94fe56e73c97 req-b5f3a36c-f04e-4245-83a5-e2af97dd3ad1 service nova] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2f3765a6-082d-4c28-8f4d-94fe56e73c97 req-b5f3a36c-f04e-4245-83a5-e2af97dd3ad1 service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2f3765a6-082d-4c28-8f4d-94fe56e73c97 req-b5f3a36c-f04e-4245-83a5-e2af97dd3ad1 service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-2f3765a6-082d-4c28-8f4d-94fe56e73c97 req-b5f3a36c-f04e-4245-83a5-e2af97dd3ad1 service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] No waiting events found dispatching network-vif-unplugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:26 user nova-compute[73052]: WARNING nova.compute.manager [req-2f3765a6-082d-4c28-8f4d-94fe56e73c97 req-b5f3a36c-f04e-4245-83a5-e2af97dd3ad1 service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received unexpected event network-vif-unplugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 for instance with vm_state active and task_state rebuilding.
Aug 26 14:55:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:26 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Took 4.68 seconds to deallocate network for instance.
Aug 26 14:55:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance destroyed successfully.
Aug 26 14:55:26 user nova-compute[73052]: INFO nova.compute.manager [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Detaching volume 80173a02-2f46-4208-8ac1-14747ee27b53
Aug 26 14:55:26 user nova-compute[73052]: INFO nova.virt.block_device [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Attempting to driver detach volume 80173a02-2f46-4208-8ac1-14747ee27b53 from mountpoint /dev/vdb
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Attempting to detach device vdb from instance d8fbdddb-dece-4881-bf03-96040e3c731d from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:55:26 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:55:26 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:55:26 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:55:26 user nova-compute[73052]:   <serial>80173a02-2f46-4208-8ac1-14747ee27b53</serial>
Aug 26 14:55:26 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:55:26 user nova-compute[73052]: </disk>
Aug 26 14:55:26 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:55:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully detached device vdb from instance d8fbdddb-dece-4881-bf03-96040e3c731d from the persistent domain config.
Aug 26 14:55:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZWXesYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:26 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 14:55:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc66695-5757-4bec-af48-77cecc84aabb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e8d751-3699-4117-ba93-666605a33ef5]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:26 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:26 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:26 user nova-compute[73052]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:55:26 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:26 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:26 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:26 user nova-compute[73052]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:55:26 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c63d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a15c9-c0e1-4118-a176-6cd8eb7c275e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afabe69-ff6d-4820-b31d-7d212aa7ff93]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d0d5e6-be72-440b-bf6a-da76699a0eb8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[06696520-3f18-4de2-942a-d443b5d90ea9]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf6d85-2a1a-4df9-a6ff-376397e05080]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[40333bed-9684-40bf-a104-8c7942b871de]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260]
Aug 26 14:55:27 user nova-compute[73052]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260] successful.
Aug 26 14:55:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e1741-9a98-44e7-b279-bcaac3f71e04]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== disconnect_volume: return (349ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG nova.network.neutron [req-8f427ae4-1696-46ac-901e-aafb6aa41626 req-80483311-1f8e-40df-9f0e-80f08ea301f1 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Updated VIF entry in instance network info cache for port 93bd7100-3306-44b9-b79a-7f693b42fd50. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG nova.network.neutron [req-8f427ae4-1696-46ac-901e-aafb6aa41626 req-80483311-1f8e-40df-9f0e-80f08ea301f1 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Updating instance_info_cache with network_info: [{"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:27 user nova-compute[73052]: INFO nova.compute.manager [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Terminating instance
Aug 26 14:55:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8f427ae4-1696-46ac-901e-aafb6aa41626 req-80483311-1f8e-40df-9f0e-80f08ea301f1 service nova] Releasing lock "refresh_cache-75b47e02-ff4b-4c57-93d3-4bca7eacc737" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-39af4f52-0485-4755-9590-2d6bda279bf0 req-e9907434-948e-40aa-8e83-293afbc0acac service nova] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Received event network-vif-deleted-6c091ed1-30d3-4b40-985f-2db76f7b8862 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Instance destroyed successfully.
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'resources' on Instance uuid 75b47e02-ff4b-4c57-93d3-4bca7eacc737 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1504653365',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1504653365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1504653365',id=30,image_ref='4e9fb336-9278-402b-ac95-ae36540f972f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrMZYhP7RjTTZSBWjd0i2uapmfR6RNxQ3oD5MFJO559cn9tJXGFZ9y/sutBjhG9CwdOmj7EVjp/3e317pplvTvzkLdQsO8CxPHyAK4qoJevI2pdE7STAuzxCniNc3e35g==',key_name='tempest-keypair-1439082707',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-x2zl4q60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-772605316',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=75b47e02-ff4b-4c57-93d3-4bca7eacc737,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "93bd7100-3306-44b9-b79a-7f693b42fd50", "address": "fa:16:3e:e6:be:25", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bd7100-33", "ovs_interfaceid": "93bd7100-3306-44b9-b79a-7f693b42fd50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:be:25,bridge_name='br-int',has_traffic_filtering=True,id=93bd7100-3306-44b9-b79a-7f693b42fd50,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bd7100-33') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_vif [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:be:25,bridge_name='br-int',has_traffic_filtering=True,id=93bd7100-3306-44b9-b79a-7f693b42fd50,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bd7100-33') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93bd7100-33, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:28 user nova-compute[73052]: INFO os_vif [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:be:25,bridge_name='br-int',has_traffic_filtering=True,id=93bd7100-3306-44b9-b79a-7f693b42fd50,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bd7100-33')
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received event network-vif-unplugged-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] Acquiring lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] No waiting events found dispatching network-vif-unplugged-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received event network-vif-unplugged-93bd7100-3306-44b9-b79a-7f693b42fd50 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received event network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] Acquiring lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] No waiting events found dispatching network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:28 user nova-compute[73052]: WARNING nova.compute.manager [req-b87e0eac-dac3-490b-b6d2-2018cc60d25d req-81ab6096-1abf-40cd-af44-6e4b92ebce2e service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received unexpected event network-vif-plugged-93bd7100-3306-44b9-b79a-7f693b42fd50 for instance with vm_state active and task_state deleting.
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IymAVxSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:28 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-62a6a4aa-b886-4f87-b33e-cfe07de9068f req-abb670a6-7e32-47e1-bf53-52b22b784a5f service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62a6a4aa-b886-4f87-b33e-cfe07de9068f req-abb670a6-7e32-47e1-bf53-52b22b784a5f service nova] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62a6a4aa-b886-4f87-b33e-cfe07de9068f req-abb670a6-7e32-47e1-bf53-52b22b784a5f service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62a6a4aa-b886-4f87-b33e-cfe07de9068f req-abb670a6-7e32-47e1-bf53-52b22b784a5f service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-62a6a4aa-b886-4f87-b33e-cfe07de9068f req-abb670a6-7e32-47e1-bf53-52b22b784a5f service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] No waiting events found dispatching network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:28 user nova-compute[73052]: WARNING nova.compute.manager [req-62a6a4aa-b886-4f87-b33e-cfe07de9068f req-abb670a6-7e32-47e1-bf53-52b22b784a5f service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received unexpected event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 for instance with vm_state active and task_state rebuilding.
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d44f6-f1e7-46e3-8cbb-328d980342ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance destroyed successfully.
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2040530059',display_name='tempest-ServerActionsTestOtherA-server-990279462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2040530059',id=29,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfhquXrIGjGxXYztmgLJzSQQlgnewhkKqp9DxFH0DM8MZ8W5nr5mod0b8V90UIh1B93o92HL2vTz+YFWuNMdp4aBB1FnzjU9k3D0nnFG2lp2L3jpmRp0uRikTpZhcgD7w==',key_name='tempest-keypair-1035979049',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-0biclnlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:55:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=d8fbdddb-dece-4881-bf03-96040e3c731d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_vif [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap770c3e91-7e, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:28 user nova-compute[73052]: INFO os_vif [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e')
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZWXesYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:28 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e2d067-35f2-43e3-873b-8e8e39f4bf29]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:28 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:28 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:28 user nova-compute[73052]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f (non-flash)
Aug 26 14:55:28 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c732950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f'): ({'sdh'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Removing single pathed devices sdh {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a785d8f0-cfaf-4fdc-a516-6eb8d6d7ee8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[147bd5c0-fce4-49b0-948c-b736fc07af40]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flushing IO for device /dev/sdh {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[853fd269-d8bd-477e-94dd-c00a97e1f8e7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312f0da-36a1-4765-8f9a-fb5ba1f1d644]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] SCSI volumes sdh have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4497c594', '/dev/disk/by-id/scsi-23838333639643131', '/dev/disk/by-id/scsi-1SCST_BIO4497c594-88369d11f0e7a5b5') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd59b20-54a5-4f44-bfe3-40299fa67a5b]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af28dc7-3a26-41d0-9816-aefe1542a5f6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[be06a4aa-3fb0-49af-afb5-8f7b329921a9]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f, portal: 172.16.0.220,3260]
Aug 26 14:55:28 user nova-compute[73052]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f, portal: 172.16.0.220,3260] successful.
Aug 26 14:55:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0537c791-ba63-4e18-a095-e9485f093f9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bab41ad-8ef2-41f9-9c23-1ef3aa3d4802]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== disconnect_volume: return (316ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:55:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Deleting instance files /opt/stack/data/nova/instances/75b47e02-ff4b-4c57-93d3-4bca7eacc737_del
Aug 26 14:55:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Deletion of /opt/stack/data/nova/instances/75b47e02-ff4b-4c57-93d3-4bca7eacc737_del complete
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.262s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab9e07b-ffc9-400f-b001-8c619b30f576]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[803c003d-b3d5-4c2b-81ba-abd9cfa5839c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:28 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:28 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08b4dd28c0>, {}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Disconnecting from: [] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== disconnect_volume: return (314ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:55:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Deleting instance files /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d_del
Aug 26 14:55:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Deletion of /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d_del complete
Aug 26 14:55:28 user nova-compute[73052]: INFO nova.compute.manager [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Took 1.46 seconds to destroy the instance on the hypervisor.
Aug 26 14:55:28 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:55:28 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:55:29 user nova-compute[73052]: INFO nova.virt.block_device [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Booting with volume 80173a02-2f46-4208-8ac1-14747ee27b53 at /dev/vdb
Aug 26 14:55:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9f8506-b13c-449c-b0d5-23dd9c35ed83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07cb940-a9a6-442a-b52f-b50c48b7f9f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d0993c-2ebf-4b4c-a6e6-eae5b8c17f1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d4cd1f-c423-43c9-8761-129eee87646b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:55:29 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58348d0-cdf5-4c9c-95aa-71eae771a2a3]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updating existing volume attachment record: e3b823ab-8516-4c9f-a0bd-050454c1661c {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:55:29 user nova-compute[73052]: INFO nova.compute.manager [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Took 2.84 seconds to detach 3 volumes for instance.
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:29 user nova-compute[73052]: INFO nova.compute.manager [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Terminating instance
Aug 26 14:55:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:29 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Took 0.87 seconds to deallocate network for instance.
Aug 26 14:55:29 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:55:29 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:30 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Deleted allocations for instance 4a1dd457-797c-45b6-bc73-c6c5276acacb
Aug 26 14:55:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f5d69d27-96a2-4c87-848c-97847cd7c660 tempest-TaggedBootDevicesTest-1108680602 tempest-TaggedBootDevicesTest-1108680602-project-member] Lock "4a1dd457-797c-45b6-bc73-c6c5276acacb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.708s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-a00397eb-129c-4d3b-b09c-09e12ee51c9b req-566ef402-c64a-4024-b2c3-f44f2505a6ad service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a00397eb-129c-4d3b-b09c-09e12ee51c9b req-566ef402-c64a-4024-b2c3-f44f2505a6ad service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a00397eb-129c-4d3b-b09c-09e12ee51c9b req-566ef402-c64a-4024-b2c3-f44f2505a6ad service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a00397eb-129c-4d3b-b09c-09e12ee51c9b req-566ef402-c64a-4024-b2c3-f44f2505a6ad service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-a00397eb-129c-4d3b-b09c-09e12ee51c9b req-566ef402-c64a-4024-b2c3-f44f2505a6ad service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-a00397eb-129c-4d3b-b09c-09e12ee51c9b req-566ef402-c64a-4024-b2c3-f44f2505a6ad service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-unplugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-be8b7e4c-be4e-4741-bb0f-d1cc48a3d5b6 req-1d11813f-4cf0-4ac3-b548-0332da40a759 service nova] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Received event network-vif-deleted-93bd7100-3306-44b9-b79a-7f693b42fd50 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:30 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Instance destroyed successfully.
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.objects.instance [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'resources' on Instance uuid 2b3a3e44-b6be-4d68-b034-843d74ba9334 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-883597149',display_name='tempest-ServerRescueNegativeTestJSON-server-883597149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-883597149',id=23,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCDGw/VQjctZ1orDhsFcUzz7rd/4Dd1cG8YisvxzGO2T2XqjX2DilbipG80gJz39D6Eje9bPcXWrWRK9h0UFTmKk1+Lj9whfIwlTyfyDx3BokkGHMhW57eBG0HpzhnvSQ==',key_name='tempest-keypair-672801022',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-enh4hvpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='966347969be04bb9a69cbdc441a94d8f',uuid=2b3a3e44-b6be-4d68-b034-843d74ba9334,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "address": "fa:16:3e:17:bc:26", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c2dcf-f8", "ovs_interfaceid": "d42c2dcf-f8f8-4178-a32b-faea50050dcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:bc:26,bridge_name='br-int',has_traffic_filtering=True,id=d42c2dcf-f8f8-4178-a32b-faea50050dcf,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c2dcf-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG os_vif [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:bc:26,bridge_name='br-int',has_traffic_filtering=True,id=d42c2dcf-f8f8-4178-a32b-faea50050dcf,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c2dcf-f8') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd42c2dcf-f8, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:30 user nova-compute[73052]: INFO os_vif [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:bc:26,bridge_name='br-int',has_traffic_filtering=True,id=d42c2dcf-f8f8-4178-a32b-faea50050dcf,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c2dcf-f8')
Aug 26 14:55:30 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Deleting instance files /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334_del
Aug 26 14:55:30 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Deletion of /opt/stack/data/nova/instances/2b3a3e44-b6be-4d68-b034-843d74ba9334_del complete
Aug 26 14:55:30 user nova-compute[73052]: INFO nova.compute.manager [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 14:55:30 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:55:30 user nova-compute[73052]: INFO nova.compute.manager [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Took 0.86 seconds to detach 1 volumes for instance.
Aug 26 14:55:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Deleting volume: 0537c791-ba63-4e18-a095-e9485f093f9f {{(pid=73052) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:31 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:55:31 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:55:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:31 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Deleted allocations for instance 75b47e02-ff4b-4c57-93d3-4bca7eacc737
Aug 26 14:55:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e67b2489-f12c-4bb1-9b8e-2b61deeadb15 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "75b47e02-ff4b-4c57-93d3-4bca7eacc737" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.812s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:31 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:31 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Took 0.92 seconds to deallocate network for instance.
Aug 26 14:55:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:31 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:55:31 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:55:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:31 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Deleted allocations for instance 2b3a3e44-b6be-4d68-b034-843d74ba9334
Aug 26 14:55:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-513c6976-b296-4c7f-9aab-25d8e8e84575 tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.404s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-b0075bce-6fee-4b74-a74c-6ba51d741f6e req-10ccf35d-7c0b-4a16-bd01-029065ce5872 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0075bce-6fee-4b74-a74c-6ba51d741f6e req-10ccf35d-7c0b-4a16-bd01-029065ce5872 service nova] Acquiring lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0075bce-6fee-4b74-a74c-6ba51d741f6e req-10ccf35d-7c0b-4a16-bd01-029065ce5872 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0075bce-6fee-4b74-a74c-6ba51d741f6e req-10ccf35d-7c0b-4a16-bd01-029065ce5872 service nova] Lock "2b3a3e44-b6be-4d68-b034-843d74ba9334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-b0075bce-6fee-4b74-a74c-6ba51d741f6e req-10ccf35d-7c0b-4a16-bd01-029065ce5872 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] No waiting events found dispatching network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:32 user nova-compute[73052]: WARNING nova.compute.manager [req-b0075bce-6fee-4b74-a74c-6ba51d741f6e req-10ccf35d-7c0b-4a16-bd01-029065ce5872 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received unexpected event network-vif-plugged-d42c2dcf-f8f8-4178-a32b-faea50050dcf for instance with vm_state deleted and task_state None.
Aug 26 14:55:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-1b36e0e7-e527-4ded-8f4f-a0fc7c2e5515 req-742f828c-5f94-4506-923a-149656c21577 service nova] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Received event network-vif-deleted-d42c2dcf-f8f8-4178-a32b-faea50050dcf {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:35 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061720.5103116, 4a1dd457-797c-45b6-bc73-c6c5276acacb => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:35 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] VM Stopped (Lifecycle Event)
Aug 26 14:55:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-47093f64-b4d3-4576-adfd-fe50e0ff1d01 None None] [instance: 4a1dd457-797c-45b6-bc73-c6c5276acacb] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:55:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:39 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:55:39 user nova-compute[73052]: INFO nova.compute.claims [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Claim successful on node user
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.policy [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '182f8d861f1d422aaa2ac5fbd8442f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec12a3cd3b3b4b13a00609468911ab32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:55:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Creating image(s)
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "/opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "/opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.201s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk 1073741824" returned: 0 in 0.055s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Successfully created port: 71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Cannot resize image /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Ensure instance console log exists: /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061726.6801906, d8fbdddb-dece-4881-bf03-96040e3c731d => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:41 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] VM Stopped (Lifecycle Event)
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bf782037-0d34-47df-8b63-06ad0f53a521 None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Successfully updated port: 71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquired lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:55:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-98d0fbb0-cb6f-41e4-9068-e469394d9139 req-6c08bb62-2a4f-49b0-b657-fce2bb973255 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received event network-changed-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-98d0fbb0-cb6f-41e4-9068-e469394d9139 req-6c08bb62-2a4f-49b0-b657-fce2bb973255 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Refreshing instance network info cache due to event network-changed-71ce5d69-db9a-4e03-b4de-481296af5e31. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-98d0fbb0-cb6f-41e4-9068-e469394d9139 req-6c08bb62-2a4f-49b0-b657-fce2bb973255 service nova] Acquiring lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.network.neutron [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Updating instance_info_cache with network_info: [{"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Releasing lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Instance network_info: |[{"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-98d0fbb0-cb6f-41e4-9068-e469394d9139 req-6c08bb62-2a4f-49b0-b657-fce2bb973255 service nova] Acquired lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-98d0fbb0-cb6f-41e4-9068-e469394d9139 req-6c08bb62-2a4f-49b0-b657-fce2bb973255 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Refreshing network info cache for port 71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Start _get_guest_xml network_info=[{"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:55:42 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:55:42 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-932259498',display_name='tempest-VolumesSnapshotTestJSON-instance-932259498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-932259498',id=32,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr01L6rcTzRN6tg9NEh4Dkdr9FgY/HU1daoj6IooVqQZzx0rLxZHn4s6JrTHo7S+M4PSI1/MflpyY1YppSyrBb9nwMamq2KNZAyYLBRlJeuVCqg8r4xOZgVkgMG4DR0Hw==',key_name='tempest-keypair-1269749487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec12a3cd3b3b4b13a00609468911ab32',ramdisk_id='',reservation_id='r-bvkhdi6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2099506189',owner_user_name='tempest-VolumesSnapshotTestJSON-2099506189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182f8d861f1d422aaa2ac5fbd8442f7f',uuid=dfec8dbe-de2a-4166-b4a8-4079d7b480c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converting VIF {"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1f:1f,bridge_name='br-int',has_traffic_filtering=True,id=71ce5d69-db9a-4e03-b4de-481296af5e31,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ce5d69-db') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.objects.instance [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'pci_devices' on Instance uuid dfec8dbe-de2a-4166-b4a8-4079d7b480c2 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:55:42 user nova-compute[73052]:   <uuid>dfec8dbe-de2a-4166-b4a8-4079d7b480c2</uuid>
Aug 26 14:55:42 user nova-compute[73052]:   <name>instance-00000020</name>
Aug 26 14:55:42 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:55:42 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:55:42 user nova-compute[73052]:   <metadata>
Aug 26 14:55:42 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:55:42 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:55:42 user nova-compute[73052]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-932259498</nova:name>
Aug 26 14:55:42 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:55:42</nova:creationTime>
Aug 26 14:55:42 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:55:42 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:55:42 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:55:42 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:55:42 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:55:42 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:55:42 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:55:42 user nova-compute[73052]:       <nova:owner>
Aug 26 14:55:42 user nova-compute[73052]:         <nova:user uuid="182f8d861f1d422aaa2ac5fbd8442f7f">tempest-VolumesSnapshotTestJSON-2099506189-project-member</nova:user>
Aug 26 14:55:42 user nova-compute[73052]:         <nova:project uuid="ec12a3cd3b3b4b13a00609468911ab32">tempest-VolumesSnapshotTestJSON-2099506189</nova:project>
Aug 26 14:55:42 user nova-compute[73052]:       </nova:owner>
Aug 26 14:55:42 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:55:42 user nova-compute[73052]:       <nova:ports>
Aug 26 14:55:42 user nova-compute[73052]:         <nova:port uuid="71ce5d69-db9a-4e03-b4de-481296af5e31">
Aug 26 14:55:42 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 14:55:42 user nova-compute[73052]:         </nova:port>
Aug 26 14:55:42 user nova-compute[73052]:       </nova:ports>
Aug 26 14:55:42 user nova-compute[73052]:     </nova:instance>
Aug 26 14:55:42 user nova-compute[73052]:   </metadata>
Aug 26 14:55:42 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:55:42 user nova-compute[73052]:     <system>
Aug 26 14:55:42 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:55:42 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:55:42 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:55:42 user nova-compute[73052]:       <entry name="serial">dfec8dbe-de2a-4166-b4a8-4079d7b480c2</entry>
Aug 26 14:55:42 user nova-compute[73052]:       <entry name="uuid">dfec8dbe-de2a-4166-b4a8-4079d7b480c2</entry>
Aug 26 14:55:42 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:55:42 user nova-compute[73052]:     </system>
Aug 26 14:55:42 user nova-compute[73052]:   </sysinfo>
Aug 26 14:55:42 user nova-compute[73052]:   <os>
Aug 26 14:55:42 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:55:42 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:55:42 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:55:42 user nova-compute[73052]:   </os>
Aug 26 14:55:42 user nova-compute[73052]:   <features>
Aug 26 14:55:42 user nova-compute[73052]:     <acpi/>
Aug 26 14:55:42 user nova-compute[73052]:     <apic/>
Aug 26 14:55:42 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:55:42 user nova-compute[73052]:   </features>
Aug 26 14:55:42 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:55:42 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:55:42 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:55:42 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:55:42 user nova-compute[73052]:   </clock>
Aug 26 14:55:42 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:55:42 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:55:42 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:55:42 user nova-compute[73052]:   </cpu>
Aug 26 14:55:42 user nova-compute[73052]:   <devices>
Aug 26 14:55:42 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:55:42 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:55:42 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk"/>
Aug 26 14:55:42 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:55:42 user nova-compute[73052]:     </disk>
Aug 26 14:55:42 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:55:42 user nova-compute[73052]:       <mac address="fa:16:3e:18:1f:1f"/>
Aug 26 14:55:42 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:55:42 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:55:42 user nova-compute[73052]:       <target dev="tap71ce5d69-db"/>
Aug 26 14:55:42 user nova-compute[73052]:     </interface>
Aug 26 14:55:42 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:55:42 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/console.log" append="off"/>
Aug 26 14:55:42 user nova-compute[73052]:     </serial>
Aug 26 14:55:42 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:55:42 user nova-compute[73052]:     <video>
Aug 26 14:55:42 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:55:42 user nova-compute[73052]:     </video>
Aug 26 14:55:42 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:55:42 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:55:42 user nova-compute[73052]:     </rng>
Aug 26 14:55:42 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:55:42 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:55:42 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:55:42 user nova-compute[73052]:     </memballoon>
Aug 26 14:55:42 user nova-compute[73052]:   </devices>
Aug 26 14:55:42 user nova-compute[73052]: </domain>
Aug 26 14:55:42 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-932259498',display_name='tempest-VolumesSnapshotTestJSON-instance-932259498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-932259498',id=32,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr01L6rcTzRN6tg9NEh4Dkdr9FgY/HU1daoj6IooVqQZzx0rLxZHn4s6JrTHo7S+M4PSI1/MflpyY1YppSyrBb9nwMamq2KNZAyYLBRlJeuVCqg8r4xOZgVkgMG4DR0Hw==',key_name='tempest-keypair-1269749487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec12a3cd3b3b4b13a00609468911ab32',ramdisk_id='',reservation_id='r-bvkhdi6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2099506189',owner_user_name='tempest-VolumesSnapshotTestJSON-2099506189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182f8d861f1d422aaa2ac5fbd8442f7f',uuid=dfec8dbe-de2a-4166-b4a8-4079d7b480c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converting VIF {"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1f:1f,bridge_name='br-int',has_traffic_filtering=True,id=71ce5d69-db9a-4e03-b4de-481296af5e31,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ce5d69-db') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG os_vif [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1f:1f,bridge_name='br-int',has_traffic_filtering=True,id=71ce5d69-db9a-4e03-b4de-481296af5e31,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ce5d69-db') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71ce5d69-db, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71ce5d69-db, col_values=(('external_ids', {'iface-id': '71ce5d69-db9a-4e03-b4de-481296af5e31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:1f:1f', 'vm-uuid': 'dfec8dbe-de2a-4166-b4a8-4079d7b480c2'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:42 user nova-compute[73052]: INFO os_vif [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1f:1f,bridge_name='br-int',has_traffic_filtering=True,id=71ce5d69-db9a-4e03-b4de-481296af5e31,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ce5d69-db')
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No VIF found with MAC fa:16:3e:18:1f:1f, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-98d0fbb0-cb6f-41e4-9068-e469394d9139 req-6c08bb62-2a4f-49b0-b657-fce2bb973255 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Updated VIF entry in instance network info cache for port 71ce5d69-db9a-4e03-b4de-481296af5e31. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-98d0fbb0-cb6f-41e4-9068-e469394d9139 req-6c08bb62-2a4f-49b0-b657-fce2bb973255 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Updating instance_info_cache with network_info: [{"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:55:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-98d0fbb0-cb6f-41e4-9068-e469394d9139 req-6c08bb62-2a4f-49b0-b657-fce2bb973255 service nova] Releasing lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:55:43 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061728.284574, 75b47e02-ff4b-4c57-93d3-4bca7eacc737 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:43 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] VM Stopped (Lifecycle Event)
Aug 26 14:55:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-a56de3c4-048a-4bbb-a4f9-81fd2d222b28 None None] [instance: 75b47e02-ff4b-4c57-93d3-4bca7eacc737] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-356255e5-c91b-4305-8cbc-485fcdd47958 req-0abd4f70-fc07-419d-a987-1e08902ca6dd service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received event network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356255e5-c91b-4305-8cbc-485fcdd47958 req-0abd4f70-fc07-419d-a987-1e08902ca6dd service nova] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356255e5-c91b-4305-8cbc-485fcdd47958 req-0abd4f70-fc07-419d-a987-1e08902ca6dd service nova] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-356255e5-c91b-4305-8cbc-485fcdd47958 req-0abd4f70-fc07-419d-a987-1e08902ca6dd service nova] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-356255e5-c91b-4305-8cbc-485fcdd47958 req-0abd4f70-fc07-419d-a987-1e08902ca6dd service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] No waiting events found dispatching network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:44 user nova-compute[73052]: WARNING nova.compute.manager [req-356255e5-c91b-4305-8cbc-485fcdd47958 req-0abd4f70-fc07-419d-a987-1e08902ca6dd service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received unexpected event network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 for instance with vm_state building and task_state spawning.
Aug 26 14:55:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:45 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061730.5250762, 2b3a3e44-b6be-4d68-b034-843d74ba9334 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:45 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] VM Stopped (Lifecycle Event)
Aug 26 14:55:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-386d0b71-7e64-4bc9-a00c-d7544bf9b921 None None] [instance: 2b3a3e44-b6be-4d68-b034-843d74ba9334] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061746.1180105, dfec8dbe-de2a-4166-b4a8-4079d7b480c2 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] VM Resumed (Lifecycle Event)
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:55:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Instance spawned successfully.
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-c872aff0-5a06-4324-bf57-cc6113cce833 req-ca554731-2b03-4781-b37e-f51dafc86784 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received event network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c872aff0-5a06-4324-bf57-cc6113cce833 req-ca554731-2b03-4781-b37e-f51dafc86784 service nova] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c872aff0-5a06-4324-bf57-cc6113cce833 req-ca554731-2b03-4781-b37e-f51dafc86784 service nova] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c872aff0-5a06-4324-bf57-cc6113cce833 req-ca554731-2b03-4781-b37e-f51dafc86784 service nova] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-c872aff0-5a06-4324-bf57-cc6113cce833 req-ca554731-2b03-4781-b37e-f51dafc86784 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] No waiting events found dispatching network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:46 user nova-compute[73052]: WARNING nova.compute.manager [req-c872aff0-5a06-4324-bf57-cc6113cce833 req-ca554731-2b03-4781-b37e-f51dafc86784 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received unexpected event network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 for instance with vm_state building and task_state spawning.
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:55:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061746.12202, dfec8dbe-de2a-4166-b4a8-4079d7b480c2 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] VM Started (Lifecycle Event)
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:55:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:55:46 user nova-compute[73052]: INFO nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 26 14:55:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:46 user nova-compute[73052]: INFO nova.compute.manager [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Took 6.73 seconds to build instance.
Aug 26 14:55:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-200c3135-423d-44cb-b010-5e91cba6769d tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.838s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:55:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Creating image(s)
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.216s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.226s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk 1073741824" returned: 0 in 0.056s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Cannot resize image /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Ensure instance console log exists: /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Start _get_guest_xml network_info=[{"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e3b823ab-8516-4c9f-a0bd-050454c1661c', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZWXesYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8fbdddb-dece-4881-bf03-96040e3c731d', 'attached_at': '', 'detached_at': '', 'volume_id': '80173a02-2f46-4208-8ac1-14747ee27b53', 'serial': '80173a02-2f46-4208-8ac1-14747ee27b53'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:55:50 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 14:55:50 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8fbdddb-dece-4881-bf03-96040e3c731d {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZWXesYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:55:50 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:50 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:55:50 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790ecff-e1ff-4570-b16c-c77c9d979eb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:55:50 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f97156-7719-4f1f-b332-1714e1a0b2ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53] added
Aug 26 14:55:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf694f1-7530-46d2-842f-25c90f637737]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3106e57-52cc-454a-9f1c-fdae46df2509]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZWXesYp {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZWXesYp" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c54e1d-b0d5-4f9a-a2a5-d2452056cadb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZWXesYp'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ba41a8-9eee-4748-a3df-00369529d96c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1557af12-e38a-472b-9033-1bbbe911390d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a7452-8bff-4594-b37d-f28e6bc992ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260]
Aug 26 14:55:50 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260] successful.
Aug 26 14:55:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb08a6-c68c-4cd9-a66b-9697abd0e346]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9533f7-71ea-4455-bea3-0790432083e2]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:55:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[507e3096-e0f7-4c8f-b3f4-811d2c39889f]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:55:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZWXesYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23234646462643666', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234646462643666', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2040530059',display_name='tempest-ServerActionsTestOtherA-server-990279462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2040530059',id=29,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfhquXrIGjGxXYztmgLJzSQQlgnewhkKqp9DxFH0DM8MZ8W5nr5mod0b8V90UIh1B93o92HL2vTz+YFWuNMdp4aBB1FnzjU9k3D0nnFG2lp2L3jpmRp0uRikTpZhcgD7w==',key_name='tempest-keypair-1035979049',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-0biclnlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=d8fbdddb-dece-4881-bf03-96040e3c731d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:55:51 user nova-compute[73052]:   <uuid>d8fbdddb-dece-4881-bf03-96040e3c731d</uuid>
Aug 26 14:55:51 user nova-compute[73052]:   <name>instance-0000001d</name>
Aug 26 14:55:51 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:55:51 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:55:51 user nova-compute[73052]:   <metadata>
Aug 26 14:55:51 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:55:51 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:55:51 user nova-compute[73052]:       <nova:name>tempest-ServerActionsTestOtherA-server-990279462</nova:name>
Aug 26 14:55:51 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:55:50</nova:creationTime>
Aug 26 14:55:51 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:55:51 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:55:51 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:55:51 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:55:51 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:55:51 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:55:51 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:55:51 user nova-compute[73052]:       <nova:owner>
Aug 26 14:55:51 user nova-compute[73052]:         <nova:user uuid="5061033588974e7ead6c7abc8a47308e">tempest-ServerActionsTestOtherA-1682869035-project-member</nova:user>
Aug 26 14:55:51 user nova-compute[73052]:         <nova:project uuid="eb3fc9a170804f0ebfa2dde967e3fec2">tempest-ServerActionsTestOtherA-1682869035</nova:project>
Aug 26 14:55:51 user nova-compute[73052]:       </nova:owner>
Aug 26 14:55:51 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:55:51 user nova-compute[73052]:       <nova:ports>
Aug 26 14:55:51 user nova-compute[73052]:         <nova:port uuid="770c3e91-7e2f-4dc9-9b6f-395dc26faf87">
Aug 26 14:55:51 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 14:55:51 user nova-compute[73052]:         </nova:port>
Aug 26 14:55:51 user nova-compute[73052]:       </nova:ports>
Aug 26 14:55:51 user nova-compute[73052]:     </nova:instance>
Aug 26 14:55:51 user nova-compute[73052]:   </metadata>
Aug 26 14:55:51 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:55:51 user nova-compute[73052]:     <system>
Aug 26 14:55:51 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:55:51 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:55:51 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:55:51 user nova-compute[73052]:       <entry name="serial">d8fbdddb-dece-4881-bf03-96040e3c731d</entry>
Aug 26 14:55:51 user nova-compute[73052]:       <entry name="uuid">d8fbdddb-dece-4881-bf03-96040e3c731d</entry>
Aug 26 14:55:51 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:55:51 user nova-compute[73052]:     </system>
Aug 26 14:55:51 user nova-compute[73052]:   </sysinfo>
Aug 26 14:55:51 user nova-compute[73052]:   <os>
Aug 26 14:55:51 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:55:51 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:55:51 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:55:51 user nova-compute[73052]:   </os>
Aug 26 14:55:51 user nova-compute[73052]:   <features>
Aug 26 14:55:51 user nova-compute[73052]:     <acpi/>
Aug 26 14:55:51 user nova-compute[73052]:     <apic/>
Aug 26 14:55:51 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:55:51 user nova-compute[73052]:   </features>
Aug 26 14:55:51 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:55:51 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:55:51 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:55:51 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:55:51 user nova-compute[73052]:   </clock>
Aug 26 14:55:51 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:55:51 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:55:51 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:55:51 user nova-compute[73052]:   </cpu>
Aug 26 14:55:51 user nova-compute[73052]:   <devices>
Aug 26 14:55:51 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:55:51 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:55:51 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk"/>
Aug 26 14:55:51 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:55:51 user nova-compute[73052]:     </disk>
Aug 26 14:55:51 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:55:51 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:55:51 user nova-compute[73052]:       <source dev="/dev/sdc"/>
Aug 26 14:55:51 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 14:55:51 user nova-compute[73052]:       <serial>80173a02-2f46-4208-8ac1-14747ee27b53</serial>
Aug 26 14:55:51 user nova-compute[73052]:     </disk>
Aug 26 14:55:51 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:55:51 user nova-compute[73052]:       <mac address="fa:16:3e:22:ab:2e"/>
Aug 26 14:55:51 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:55:51 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:55:51 user nova-compute[73052]:       <target dev="tap770c3e91-7e"/>
Aug 26 14:55:51 user nova-compute[73052]:     </interface>
Aug 26 14:55:51 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:55:51 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/console.log" append="off"/>
Aug 26 14:55:51 user nova-compute[73052]:     </serial>
Aug 26 14:55:51 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:55:51 user nova-compute[73052]:     <video>
Aug 26 14:55:51 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:55:51 user nova-compute[73052]:     </video>
Aug 26 14:55:51 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:55:51 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:55:51 user nova-compute[73052]:     </rng>
Aug 26 14:55:51 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:55:51 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:55:51 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:55:51 user nova-compute[73052]:     </memballoon>
Aug 26 14:55:51 user nova-compute[73052]:   </devices>
Aug 26 14:55:51 user nova-compute[73052]: </domain>
Aug 26 14:55:51 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2040530059',display_name='tempest-ServerActionsTestOtherA-server-990279462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2040530059',id=29,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfhquXrIGjGxXYztmgLJzSQQlgnewhkKqp9DxFH0DM8MZ8W5nr5mod0b8V90UIh1B93o92HL2vTz+YFWuNMdp4aBB1FnzjU9k3D0nnFG2lp2L3jpmRp0uRikTpZhcgD7w==',key_name='tempest-keypair-1035979049',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-0biclnlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=d8fbdddb-dece-4881-bf03-96040e3c731d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG os_vif [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap770c3e91-7e, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap770c3e91-7e, col_values=(('external_ids', {'iface-id': '770c3e91-7e2f-4dc9-9b6f-395dc26faf87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ab:2e', 'vm-uuid': 'd8fbdddb-dece-4881-bf03-96040e3c731d'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:55:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:55:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:52 user nova-compute[73052]: INFO os_vif [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e')
Aug 26 14:55:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:55:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:55:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No VIF found with MAC fa:16:3e:22:ab:2e, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-d06d27d2-519a-4aed-8c1d-dfac5bfffb71 req-71ec6e73-a27d-4f3e-a5c8-671ca5c9e89a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d06d27d2-519a-4aed-8c1d-dfac5bfffb71 req-71ec6e73-a27d-4f3e-a5c8-671ca5c9e89a service nova] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d06d27d2-519a-4aed-8c1d-dfac5bfffb71 req-71ec6e73-a27d-4f3e-a5c8-671ca5c9e89a service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d06d27d2-519a-4aed-8c1d-dfac5bfffb71 req-71ec6e73-a27d-4f3e-a5c8-671ca5c9e89a service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-d06d27d2-519a-4aed-8c1d-dfac5bfffb71 req-71ec6e73-a27d-4f3e-a5c8-671ca5c9e89a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] No waiting events found dispatching network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:53 user nova-compute[73052]: WARNING nova.compute.manager [req-d06d27d2-519a-4aed-8c1d-dfac5bfffb71 req-71ec6e73-a27d-4f3e-a5c8-671ca5c9e89a service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received unexpected event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 14:55:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061755.8166616, d8fbdddb-dece-4881-bf03-96040e3c731d => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:55 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] VM Resumed (Lifecycle Event)
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:55:55 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance spawned successfully.
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:55:55 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061755.8177807, d8fbdddb-dece-4881-bf03-96040e3c731d => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:55:55 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] VM Started (Lifecycle Event)
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.compute.manager [req-809ff2b2-52e5-4a8f-b054-9a525e3bb777 req-24c29216-6e44-46aa-8396-2a6bddd1593c service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-809ff2b2-52e5-4a8f-b054-9a525e3bb777 req-24c29216-6e44-46aa-8396-2a6bddd1593c service nova] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-809ff2b2-52e5-4a8f-b054-9a525e3bb777 req-24c29216-6e44-46aa-8396-2a6bddd1593c service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-809ff2b2-52e5-4a8f-b054-9a525e3bb777 req-24c29216-6e44-46aa-8396-2a6bddd1593c service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.compute.manager [req-809ff2b2-52e5-4a8f-b054-9a525e3bb777 req-24c29216-6e44-46aa-8396-2a6bddd1593c service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] No waiting events found dispatching network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:55:55 user nova-compute[73052]: WARNING nova.compute.manager [req-809ff2b2-52e5-4a8f-b054-9a525e3bb777 req-24c29216-6e44-46aa-8396-2a6bddd1593c service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received unexpected event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:55:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:55:55 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 14:55:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:55:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:55:56 user nova-compute[73052]: DEBUG nova.objects.instance [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73052) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 14:55:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-880c6e65-e8e5-4fc5-952a-06e11419fe86 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:55:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:56:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:56:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:56:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:56:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:12 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:56:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:16 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:56:16 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7511MB free_disk=25.1922607421875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance eb6033f4-da59-4900-a67f-1e244631f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 7acb8d8e-f559-412c-91b3-e20f2df2a09a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d8fbdddb-dece-4881-bf03-96040e3c731d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e709cd6a-f799-4b23-af84-436bc8d7f0a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 14:56:16 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.658s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 14:56:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:24 user nova-compute[73052]: INFO nova.compute.manager [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Terminating instance
Aug 26 14:56:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e861f27-47ce-4e8a-aef4-cb1d60d38292 req-54c7def2-89b6-42fb-948e-84a43fbbcf9a service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received event network-vif-unplugged-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e861f27-47ce-4e8a-aef4-cb1d60d38292 req-54c7def2-89b6-42fb-948e-84a43fbbcf9a service nova] Acquiring lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e861f27-47ce-4e8a-aef4-cb1d60d38292 req-54c7def2-89b6-42fb-948e-84a43fbbcf9a service nova] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9e861f27-47ce-4e8a-aef4-cb1d60d38292 req-54c7def2-89b6-42fb-948e-84a43fbbcf9a service nova] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e861f27-47ce-4e8a-aef4-cb1d60d38292 req-54c7def2-89b6-42fb-948e-84a43fbbcf9a service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] No waiting events found dispatching network-vif-unplugged-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:56:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-9e861f27-47ce-4e8a-aef4-cb1d60d38292 req-54c7def2-89b6-42fb-948e-84a43fbbcf9a service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received event network-vif-unplugged-75a40adb-a6f1-417c-a129-41ea989a0334 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:56:25 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Instance destroyed successfully.
Aug 26 14:56:25 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'resources' on Instance uuid 7acb8d8e-f559-412c-91b3-e20f2df2a09a {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:51:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1065386742',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1065386742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1065386742',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXjfLsGlfK0zuSRneP+pI7xTfQX69+QNDzYWbG2m0lP+hNfpYp5qgb4dp0wAZ/idUeKvVL5FnAxGTmbJLXD+K9SmMQozuBAWdnmMse9VQ9OkCQzQT9LEADIxP1DpVOYDg==',key_name='tempest-keypair-1340868528',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:51:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-li7dhk3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=7acb8d8e-f559-412c-91b3-e20f2df2a09a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "75a40adb-a6f1-417c-a129-41ea989a0334", "address": "fa:16:3e:40:3d:9d", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a40adb-a6", "ovs_interfaceid": "75a40adb-a6f1-417c-a129-41ea989a0334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:3d:9d,bridge_name='br-int',has_traffic_filtering=True,id=75a40adb-a6f1-417c-a129-41ea989a0334,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a40adb-a6') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_vif [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:3d:9d,bridge_name='br-int',has_traffic_filtering=True,id=75a40adb-a6f1-417c-a129-41ea989a0334,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a40adb-a6') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a40adb-a6, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:56:25 user nova-compute[73052]: INFO os_vif [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:3d:9d,bridge_name='br-int',has_traffic_filtering=True,id=75a40adb-a6f1-417c-a129-41ea989a0334,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a40adb-a6')
Aug 26 14:56:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjIUZgpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:56:25 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[af87f9c5-c247-4ff6-ae20-45695edd9293]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[542edea7-1014-4e2b-b8a4-b45df48ce0ac]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:56:25 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:56:25 user nova-compute[73052]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:56:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 (non-flash)
Aug 26 14:56:25 user nova-compute[73052]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:56:25 user nova-compute[73052]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:56:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0187490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e96f4d-383e-4cc1-bf44-e151df237961]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1fa32a-b355-4a93-8dce-ea911ffc9a6b]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3857f12-6d09-4bab-a662-afd634f519ea]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c026d-54e8-4683-a801-f3bec2aed0f8]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23339653430623831', '/dev/disk/by-id/scsi-1SCST_BIO767fe37e-39e40b81200694a5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_767fe37e') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d82d5-3c44-4b43-9d16-d11d17642efd]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.204s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f260a681-1113-464e-bb40-fddff9d5f3b2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e686e3f-b691-45b2-92c7-9fb44d72e994]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631, portal: 172.16.0.220,3260]
Aug 26 14:56:25 user nova-compute[73052]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631, portal: 172.16.0.220,3260] successful.
Aug 26 14:56:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0df67-c292-445b-8ecf-c06ec3d43631 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08faaf4-5176-46d7-906a-f7917089417b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.510s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== disconnect_volume: return (511ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:56:25 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Deleting instance files /opt/stack/data/nova/instances/7acb8d8e-f559-412c-91b3-e20f2df2a09a_del
Aug 26 14:56:25 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Deletion of /opt/stack/data/nova/instances/7acb8d8e-f559-412c-91b3-e20f2df2a09a_del complete
Aug 26 14:56:25 user nova-compute[73052]: INFO nova.compute.manager [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 26 14:56:25 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:56:25 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:56:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:26 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-041d86bf-e347-4f5a-a5d0-2ef9848f24cc req-a2b4d3cf-fbb5-447c-b3fb-54c82a9dbcc9 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received event network-vif-deleted-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:26 user nova-compute[73052]: INFO nova.compute.manager [req-041d86bf-e347-4f5a-a5d0-2ef9848f24cc req-a2b4d3cf-fbb5-447c-b3fb-54c82a9dbcc9 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Neutron deleted interface 75a40adb-a6f1-417c-a129-41ea989a0334; detaching it from the instance and deleting it from the info cache
Aug 26 14:56:26 user nova-compute[73052]: DEBUG nova.network.neutron [req-041d86bf-e347-4f5a-a5d0-2ef9848f24cc req-a2b4d3cf-fbb5-447c-b3fb-54c82a9dbcc9 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:26 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Took 1.00 seconds to deallocate network for instance.
Aug 26 14:56:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-041d86bf-e347-4f5a-a5d0-2ef9848f24cc req-a2b4d3cf-fbb5-447c-b3fb-54c82a9dbcc9 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Detach interface failed, port_id=75a40adb-a6f1-417c-a129-41ea989a0334, reason: Instance 7acb8d8e-f559-412c-91b3-e20f2df2a09a could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:56:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-2db57d8b-3a24-4ad5-a12b-9178fe297e96 req-0cfac66b-2b79-48d0-ad2b-05b6b7ac0418 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received event network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2db57d8b-3a24-4ad5-a12b-9178fe297e96 req-0cfac66b-2b79-48d0-ad2b-05b6b7ac0418 service nova] Acquiring lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2db57d8b-3a24-4ad5-a12b-9178fe297e96 req-0cfac66b-2b79-48d0-ad2b-05b6b7ac0418 service nova] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2db57d8b-3a24-4ad5-a12b-9178fe297e96 req-0cfac66b-2b79-48d0-ad2b-05b6b7ac0418 service nova] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-2db57d8b-3a24-4ad5-a12b-9178fe297e96 req-0cfac66b-2b79-48d0-ad2b-05b6b7ac0418 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] No waiting events found dispatching network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:56:26 user nova-compute[73052]: WARNING nova.compute.manager [req-2db57d8b-3a24-4ad5-a12b-9178fe297e96 req-0cfac66b-2b79-48d0-ad2b-05b6b7ac0418 service nova] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Received unexpected event network-vif-plugged-75a40adb-a6f1-417c-a129-41ea989a0334 for instance with vm_state active and task_state deleting.
Aug 26 14:56:27 user nova-compute[73052]: INFO nova.compute.manager [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Took 0.89 seconds to detach 1 volumes for instance.
Aug 26 14:56:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Deleting volume: 36d0df67-c292-445b-8ecf-c06ec3d43631 {{(pid=73052) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 14:56:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:27 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:56:27 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:56:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:28 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Deleted allocations for instance 7acb8d8e-f559-412c-91b3-e20f2df2a09a
Aug 26 14:56:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f426ddd3-c654-4777-a5dc-99ac9e33dc71 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "7acb8d8e-f559-412c-91b3-e20f2df2a09a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.916s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:33 user nova-compute[73052]: INFO nova.compute.manager [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Terminating instance
Aug 26 14:56:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-253b15dc-d480-4f4e-b5f9-8d3959e89d55 req-2f8ead72-1cfd-4fa8-b380-694b4ca93d3c service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received event network-vif-unplugged-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-253b15dc-d480-4f4e-b5f9-8d3959e89d55 req-2f8ead72-1cfd-4fa8-b380-694b4ca93d3c service nova] Acquiring lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-253b15dc-d480-4f4e-b5f9-8d3959e89d55 req-2f8ead72-1cfd-4fa8-b380-694b4ca93d3c service nova] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-253b15dc-d480-4f4e-b5f9-8d3959e89d55 req-2f8ead72-1cfd-4fa8-b380-694b4ca93d3c service nova] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-253b15dc-d480-4f4e-b5f9-8d3959e89d55 req-2f8ead72-1cfd-4fa8-b380-694b4ca93d3c service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] No waiting events found dispatching network-vif-unplugged-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:56:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-253b15dc-d480-4f4e-b5f9-8d3959e89d55 req-2f8ead72-1cfd-4fa8-b380-694b4ca93d3c service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received event network-vif-unplugged-ef36f027-87a4-43f8-a155-ed227963e764 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:56:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Instance destroyed successfully.
Aug 26 14:56:34 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lazy-loading 'resources' on Instance uuid e709cd6a-f799-4b23-af84-436bc8d7f0a1 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1700584714',display_name='tempest-VolumesActionsTest-instance-1700584714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1700584714',id=31,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c1afa5dd9c74414a874e103410b71be',ramdisk_id='',reservation_id='r-50myqzny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1775568266',owner_user_name='tempest-VolumesActionsTest-1775568266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:54:50Z,user_data=None,user_id='ed5225f2064f43e893a054c3583a0b8f',uuid=e709cd6a-f799-4b23-af84-436bc8d7f0a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converting VIF {"id": "ef36f027-87a4-43f8-a155-ed227963e764", "address": "fa:16:3e:c9:e6:ce", "network": {"id": "5913aea2-b369-47dd-bff2-356750a5ba35", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739567319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c1afa5dd9c74414a874e103410b71be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef36f027-87", "ovs_interfaceid": "ef36f027-87a4-43f8-a155-ed227963e764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:e6:ce,bridge_name='br-int',has_traffic_filtering=True,id=ef36f027-87a4-43f8-a155-ed227963e764,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef36f027-87') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG os_vif [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:e6:ce,bridge_name='br-int',has_traffic_filtering=True,id=ef36f027-87a4-43f8-a155-ed227963e764,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef36f027-87') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef36f027-87, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:56:34 user nova-compute[73052]: INFO os_vif [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:e6:ce,bridge_name='br-int',has_traffic_filtering=True,id=ef36f027-87a4-43f8-a155-ed227963e764,network=Network(5913aea2-b369-47dd-bff2-356750a5ba35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef36f027-87')
Aug 26 14:56:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Deleting instance files /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1_del
Aug 26 14:56:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Deletion of /opt/stack/data/nova/instances/e709cd6a-f799-4b23-af84-436bc8d7f0a1_del complete
Aug 26 14:56:34 user nova-compute[73052]: INFO nova.compute.manager [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 14:56:34 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:34 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:34 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Took 0.61 seconds to deallocate network for instance.
Aug 26 14:56:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-e07a64b2-1d67-47f0-972e-d689bae7c81b req-948b9021-f591-4b06-a595-0e90f866b67f service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received event network-vif-deleted-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:35 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Deleted allocations for instance e709cd6a-f799-4b23-af84-436bc8d7f0a1
Aug 26 14:56:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e1060f80-deb1-4833-96e2-845fae30f2d7 tempest-VolumesActionsTest-1775568266 tempest-VolumesActionsTest-1775568266-project-member] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.173s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-c8544a49-28dc-40a2-ad1a-2fff267f9fe6 req-2b2ad772-a952-4b9d-bca2-915012053b20 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received event network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c8544a49-28dc-40a2-ad1a-2fff267f9fe6 req-2b2ad772-a952-4b9d-bca2-915012053b20 service nova] Acquiring lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c8544a49-28dc-40a2-ad1a-2fff267f9fe6 req-2b2ad772-a952-4b9d-bca2-915012053b20 service nova] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c8544a49-28dc-40a2-ad1a-2fff267f9fe6 req-2b2ad772-a952-4b9d-bca2-915012053b20 service nova] Lock "e709cd6a-f799-4b23-af84-436bc8d7f0a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-c8544a49-28dc-40a2-ad1a-2fff267f9fe6 req-2b2ad772-a952-4b9d-bca2-915012053b20 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] No waiting events found dispatching network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:56:35 user nova-compute[73052]: WARNING nova.compute.manager [req-c8544a49-28dc-40a2-ad1a-2fff267f9fe6 req-2b2ad772-a952-4b9d-bca2-915012053b20 service nova] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Received unexpected event network-vif-plugged-ef36f027-87a4-43f8-a155-ed227963e764 for instance with vm_state deleted and task_state None.
Aug 26 14:56:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061785.027099, 7acb8d8e-f559-412c-91b3-e20f2df2a09a => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:56:40 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] VM Stopped (Lifecycle Event)
Aug 26 14:56:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c4fb6344-1d2b-4e1e-9264-3440c59914f3 None None] [instance: 7acb8d8e-f559-412c-91b3-e20f2df2a09a] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "eb6033f4-da59-4900-a67f-1e244631f046" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "eb6033f4-da59-4900-a67f-1e244631f046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "eb6033f4-da59-4900-a67f-1e244631f046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:40 user nova-compute[73052]: INFO nova.compute.manager [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Terminating instance
Aug 26 14:56:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:56:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Instance destroyed successfully.
Aug 26 14:56:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'resources' on Instance uuid eb6033f4-da59-4900-a67f-1e244631f046 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-245647396',display_name='tempest-ServerRescueNegativeTestJSON-server-245647396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-245647396',id=3,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:42:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-skvo5tlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:42:02Z,user_data=None,user_id='966347969be04bb9a69cbdc441a94d8f',uuid=eb6033f4-da59-4900-a67f-1e244631f046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "b3728317-0c63-410c-bdb3-60166f01310d", "address": "fa:16:3e:3e:05:1e", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3728317-0c", "ovs_interfaceid": "b3728317-0c63-410c-bdb3-60166f01310d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=b3728317-0c63-410c-bdb3-60166f01310d,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3728317-0c') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG os_vif [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=b3728317-0c63-410c-bdb3-60166f01310d,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3728317-0c') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3728317-0c, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:56:41 user nova-compute[73052]: INFO os_vif [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=b3728317-0c63-410c-bdb3-60166f01310d,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3728317-0c')
Aug 26 14:56:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Deleting instance files /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046_del
Aug 26 14:56:41 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Deletion of /opt/stack/data/nova/instances/eb6033f4-da59-4900-a67f-1e244631f046_del complete
Aug 26 14:56:41 user nova-compute[73052]: INFO nova.compute.manager [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 14:56:41 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:56:41 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:56:42 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:42 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Took 1.12 seconds to deallocate network for instance.
Aug 26 14:56:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-dd902345-c60f-4148-8325-9198426a4a48 req-acdc82d6-8aa3-4c04-bdf7-502bfebb59a7 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Received event network-vif-deleted-b3728317-0c63-410c-bdb3-60166f01310d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:42 user nova-compute[73052]: INFO nova.compute.manager [req-dd902345-c60f-4148-8325-9198426a4a48 req-acdc82d6-8aa3-4c04-bdf7-502bfebb59a7 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Neutron deleted interface b3728317-0c63-410c-bdb3-60166f01310d; detaching it from the instance and deleting it from the info cache
Aug 26 14:56:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-dd902345-c60f-4148-8325-9198426a4a48 req-acdc82d6-8aa3-4c04-bdf7-502bfebb59a7 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-dd902345-c60f-4148-8325-9198426a4a48 req-acdc82d6-8aa3-4c04-bdf7-502bfebb59a7 service nova] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Detach interface failed, port_id=b3728317-0c63-410c-bdb3-60166f01310d, reason: Instance eb6033f4-da59-4900-a67f-1e244631f046 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:56:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:43 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:56:43 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:56:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:43 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Deleted allocations for instance eb6033f4-da59-4900-a67f-1e244631f046
Aug 26 14:56:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-95529a48-2f75-4351-a1fb-46b9e147730b tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "eb6033f4-da59-4900-a67f-1e244631f046" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.422s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 33ec579e-3ce9-46e3-9e06-ca91fb20571f {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid de3630fa-98b3-4a5a-b008-e98f0c72d0ea {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid d8fbdddb-dece-4881-bf03-96040e3c731d {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid dfec8dbe-de2a-4166-b4a8-4079d7b480c2 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-28fa2128-a84b-47d4-9a0e-99d633ba65f1 req-4ea5806d-f328-42bf-bcbe-300645caac67 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-28fa2128-a84b-47d4-9a0e-99d633ba65f1 req-4ea5806d-f328-42bf-bcbe-300645caac67 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing instance network info cache due to event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:56:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-28fa2128-a84b-47d4-9a0e-99d633ba65f1 req-4ea5806d-f328-42bf-bcbe-300645caac67 service nova] Acquiring lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:56:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-28fa2128-a84b-47d4-9a0e-99d633ba65f1 req-4ea5806d-f328-42bf-bcbe-300645caac67 service nova] Acquired lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:56:48 user nova-compute[73052]: DEBUG nova.network.neutron [req-28fa2128-a84b-47d4-9a0e-99d633ba65f1 req-4ea5806d-f328-42bf-bcbe-300645caac67 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:56:49 user nova-compute[73052]: DEBUG nova.network.neutron [req-28fa2128-a84b-47d4-9a0e-99d633ba65f1 req-4ea5806d-f328-42bf-bcbe-300645caac67 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updated VIF entry in instance network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:56:49 user nova-compute[73052]: DEBUG nova.network.neutron [req-28fa2128-a84b-47d4-9a0e-99d633ba65f1 req-4ea5806d-f328-42bf-bcbe-300645caac67 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating instance_info_cache with network_info: [{"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-28fa2128-a84b-47d4-9a0e-99d633ba65f1 req-4ea5806d-f328-42bf-bcbe-300645caac67 service nova] Releasing lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:56:49 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061794.2332332, e709cd6a-f799-4b23-af84-436bc8d7f0a1 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:56:49 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] VM Stopped (Lifecycle Event)
Aug 26 14:56:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2cadfd7a-c51a-4a35-91da-8722f07b7b3d None None] [instance: e709cd6a-f799-4b23-af84-436bc8d7f0a1] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:56:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:49 user nova-compute[73052]: INFO nova.compute.manager [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Detaching volume 46e100e0-13e7-408e-a948-049ebfa88076
Aug 26 14:56:49 user nova-compute[73052]: INFO nova.virt.block_device [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Attempting to driver detach volume 46e100e0-13e7-408e-a948-049ebfa88076 from mountpoint /dev/vdb
Aug 26 14:56:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Attempting to detach device vdb from instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:56:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:56:49 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:56:49 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:56:49 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:56:49 user nova-compute[73052]:   <serial>46e100e0-13e7-408e-a948-049ebfa88076</serial>
Aug 26 14:56:49 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:56:49 user nova-compute[73052]: </disk>
Aug 26 14:56:49 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:56:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully detached device vdb from instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea from the persistent domain config.
Aug 26 14:56:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:56:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:56:49 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:56:49 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:56:49 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:56:49 user nova-compute[73052]:   <serial>46e100e0-13e7-408e-a948-049ebfa88076</serial>
Aug 26 14:56:49 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:56:49 user nova-compute[73052]: </disk>
Aug 26 14:56:49 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-71a78ddd-8871-46db-8be0-9a0cbe8ebeb0 req-d62f6f73-0df2-4ec5-b852-25d352a07115 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-71a78ddd-8871-46db-8be0-9a0cbe8ebeb0 req-d62f6f73-0df2-4ec5-b852-25d352a07115 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing instance network info cache due to event network-changed-3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-71a78ddd-8871-46db-8be0-9a0cbe8ebeb0 req-d62f6f73-0df2-4ec5-b852-25d352a07115 service nova] Acquiring lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-71a78ddd-8871-46db-8be0-9a0cbe8ebeb0 req-d62f6f73-0df2-4ec5-b852-25d352a07115 service nova] Acquired lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG nova.network.neutron [req-71a78ddd-8871-46db-8be0-9a0cbe8ebeb0 req-d62f6f73-0df2-4ec5-b852-25d352a07115 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Refreshing network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061810.3531907, de3630fa-98b3-4a5a-b008-e98f0c72d0ea => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:56:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully detached device vdb from instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea from the live domain config.
Aug 26 14:56:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpyTZnog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:56:50 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148a016-44d0-43bb-a06d-fe4284690053]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e515c498-a76d-4715-8855-bc6c9bf4bc0b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:56:50 user nova-compute[73052]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:56:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 (non-flash)
Aug 26 14:56:50 user nova-compute[73052]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:56:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08b4d0cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c32d4-d9f7-405e-989e-c6f6fb3d6cf9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ff4e3-c880-44ba-8de1-68a1ffa8e45b]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e24d17-4035-4f8a-80e0-a6e9047e3583]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c8bcaa-caf1-43c8-a64e-b7e01ad6f046]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f1286-41ac-43f8-9fac-8bc9f8180b63]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db272ed-effc-4e79-9896-3767db4ade98]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076, portal: 172.16.0.220,3260]
Aug 26 14:56:50 user nova-compute[73052]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076, portal: 172.16.0.220,3260] successful.
Aug 26 14:56:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46e100e0-13e7-408e-a948-049ebfa88076 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d9aa52-c1fd-4dee-bcf8-bac7977f2c7d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] <== disconnect_volume: return (318ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:56:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:56:51 user nova-compute[73052]: INFO nova.compute.claims [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Claim successful on node user
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.network.neutron [req-71a78ddd-8871-46db-8be0-9a0cbe8ebeb0 req-d62f6f73-0df2-4ec5-b852-25d352a07115 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updated VIF entry in instance network info cache for port 3fc35180-bc12-4f46-a612-6d51786c0780. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.network.neutron [req-71a78ddd-8871-46db-8be0-9a0cbe8ebeb0 req-d62f6f73-0df2-4ec5-b852-25d352a07115 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating instance_info_cache with network_info: [{"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-71a78ddd-8871-46db-8be0-9a0cbe8ebeb0 req-d62f6f73-0df2-4ec5-b852-25d352a07115 service nova] Releasing lock "refresh_cache-de3630fa-98b3-4a5a-b008-e98f0c72d0ea" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:56:51 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'flavor' on Instance uuid de3630fa-98b3-4a5a-b008-e98f0c72d0ea {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e0d3527-902b-416f-8a94-b335f7721365 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.884s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.policy [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3768812de50c4b828c4f5ee45dffb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ac26b72a134fb68abdda1a0c860b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:56:51 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Creating image(s)
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "/opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "/opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.194s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk 1073741824" returned: 0 in 0.069s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.207s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Successfully created port: 2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Cannot resize image /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Ensure instance console log exists: /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.neutron [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Successfully updated port: 2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquired lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.neutron [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-b824d1ae-6b37-4e07-a06f-9903f800d822 req-7d0eb669-6875-467c-ac18-792c1b692911 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received event network-changed-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-b824d1ae-6b37-4e07-a06f-9903f800d822 req-7d0eb669-6875-467c-ac18-792c1b692911 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Refreshing instance network info cache due to event network-changed-2143778c-ddba-49d1-94fe-ae0a4eb13540. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b824d1ae-6b37-4e07-a06f-9903f800d822 req-7d0eb669-6875-467c-ac18-792c1b692911 service nova] Acquiring lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.neutron [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.neutron [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updating instance_info_cache with network_info: [{"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Releasing lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Instance network_info: |[{"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b824d1ae-6b37-4e07-a06f-9903f800d822 req-7d0eb669-6875-467c-ac18-792c1b692911 service nova] Acquired lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.neutron [req-b824d1ae-6b37-4e07-a06f-9903f800d822 req-7d0eb669-6875-467c-ac18-792c1b692911 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Refreshing network info cache for port 2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Start _get_guest_xml network_info=[{"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:56:53 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:56:53 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:56:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1908307852',display_name='tempest-TestServerVolumeAttachmentScenario-server-1908307852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1908307852',id=33,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO5xGjFPV0pgG0JSlcRaCnU3au792bwT1cnj+Kv3splBfk6X+NUXcw7hz3eE3jsmH0MWjIIfZgvsXBkl67dU9qdACdpPj7TiCZ489TmnntSWJWuTm3B39usRqz1ZwIsDg==',key_name='tempest-keypair-343414732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98ac26b72a134fb68abdda1a0c860b40',ramdisk_id='',reservation_id='r-aic5m0xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-951083829',owner_user_name='tempest-TestServerVolumeAttachmentScenario-951083829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:56:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3768812de50c4b828c4f5ee45dffb2d9',uuid=4a45b34c-d927-4a7e-b71a-fa665269cdc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Converting VIF {"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=2143778c-ddba-49d1-94fe-ae0a4eb13540,network=Network(66a8815d-7260-4c0c-9068-6ac4fa19888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2143778c-dd') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.objects.instance [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:56:53 user nova-compute[73052]:   <uuid>4a45b34c-d927-4a7e-b71a-fa665269cdc0</uuid>
Aug 26 14:56:53 user nova-compute[73052]:   <name>instance-00000021</name>
Aug 26 14:56:53 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:56:53 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:56:53 user nova-compute[73052]:   <metadata>
Aug 26 14:56:53 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:56:53 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:56:53 user nova-compute[73052]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1908307852</nova:name>
Aug 26 14:56:53 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:56:53</nova:creationTime>
Aug 26 14:56:53 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:56:53 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:56:53 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:56:53 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:56:53 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:56:53 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:56:53 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:56:53 user nova-compute[73052]:       <nova:owner>
Aug 26 14:56:53 user nova-compute[73052]:         <nova:user uuid="3768812de50c4b828c4f5ee45dffb2d9">tempest-TestServerVolumeAttachmentScenario-951083829-project-member</nova:user>
Aug 26 14:56:53 user nova-compute[73052]:         <nova:project uuid="98ac26b72a134fb68abdda1a0c860b40">tempest-TestServerVolumeAttachmentScenario-951083829</nova:project>
Aug 26 14:56:53 user nova-compute[73052]:       </nova:owner>
Aug 26 14:56:53 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:56:53 user nova-compute[73052]:       <nova:ports>
Aug 26 14:56:53 user nova-compute[73052]:         <nova:port uuid="2143778c-ddba-49d1-94fe-ae0a4eb13540">
Aug 26 14:56:53 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 14:56:53 user nova-compute[73052]:         </nova:port>
Aug 26 14:56:53 user nova-compute[73052]:       </nova:ports>
Aug 26 14:56:53 user nova-compute[73052]:     </nova:instance>
Aug 26 14:56:53 user nova-compute[73052]:   </metadata>
Aug 26 14:56:53 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:56:53 user nova-compute[73052]:     <system>
Aug 26 14:56:53 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:56:53 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:56:53 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:56:53 user nova-compute[73052]:       <entry name="serial">4a45b34c-d927-4a7e-b71a-fa665269cdc0</entry>
Aug 26 14:56:53 user nova-compute[73052]:       <entry name="uuid">4a45b34c-d927-4a7e-b71a-fa665269cdc0</entry>
Aug 26 14:56:53 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:56:53 user nova-compute[73052]:     </system>
Aug 26 14:56:53 user nova-compute[73052]:   </sysinfo>
Aug 26 14:56:53 user nova-compute[73052]:   <os>
Aug 26 14:56:53 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:56:53 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:56:53 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:56:53 user nova-compute[73052]:   </os>
Aug 26 14:56:53 user nova-compute[73052]:   <features>
Aug 26 14:56:53 user nova-compute[73052]:     <acpi/>
Aug 26 14:56:53 user nova-compute[73052]:     <apic/>
Aug 26 14:56:53 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:56:53 user nova-compute[73052]:   </features>
Aug 26 14:56:53 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:56:53 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:56:53 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:56:53 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:56:53 user nova-compute[73052]:   </clock>
Aug 26 14:56:53 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:56:53 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:56:53 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:56:53 user nova-compute[73052]:   </cpu>
Aug 26 14:56:53 user nova-compute[73052]:   <devices>
Aug 26 14:56:53 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:56:53 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:56:53 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk"/>
Aug 26 14:56:53 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:56:53 user nova-compute[73052]:     </disk>
Aug 26 14:56:53 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:56:53 user nova-compute[73052]:       <mac address="fa:16:3e:e5:8e:10"/>
Aug 26 14:56:53 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:56:53 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:56:53 user nova-compute[73052]:       <target dev="tap2143778c-dd"/>
Aug 26 14:56:53 user nova-compute[73052]:     </interface>
Aug 26 14:56:53 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:56:53 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/console.log" append="off"/>
Aug 26 14:56:53 user nova-compute[73052]:     </serial>
Aug 26 14:56:53 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:56:53 user nova-compute[73052]:     <video>
Aug 26 14:56:53 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:56:53 user nova-compute[73052]:     </video>
Aug 26 14:56:53 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:56:53 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:56:53 user nova-compute[73052]:     </rng>
Aug 26 14:56:53 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:56:53 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:56:53 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:56:53 user nova-compute[73052]:     </memballoon>
Aug 26 14:56:53 user nova-compute[73052]:   </devices>
Aug 26 14:56:53 user nova-compute[73052]: </domain>
Aug 26 14:56:53 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:56:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1908307852',display_name='tempest-TestServerVolumeAttachmentScenario-server-1908307852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1908307852',id=33,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO5xGjFPV0pgG0JSlcRaCnU3au792bwT1cnj+Kv3splBfk6X+NUXcw7hz3eE3jsmH0MWjIIfZgvsXBkl67dU9qdACdpPj7TiCZ489TmnntSWJWuTm3B39usRqz1ZwIsDg==',key_name='tempest-keypair-343414732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98ac26b72a134fb68abdda1a0c860b40',ramdisk_id='',reservation_id='r-aic5m0xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-951083829',owner_user_name='tempest-TestServerVolumeAttachmentScenario-951083829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:56:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3768812de50c4b828c4f5ee45dffb2d9',uuid=4a45b34c-d927-4a7e-b71a-fa665269cdc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Converting VIF {"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=2143778c-ddba-49d1-94fe-ae0a4eb13540,network=Network(66a8815d-7260-4c0c-9068-6ac4fa19888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2143778c-dd') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG os_vif [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=2143778c-ddba-49d1-94fe-ae0a4eb13540,network=Network(66a8815d-7260-4c0c-9068-6ac4fa19888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2143778c-dd') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2143778c-dd, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2143778c-dd, col_values=(('external_ids', {'iface-id': '2143778c-ddba-49d1-94fe-ae0a4eb13540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:8e:10', 'vm-uuid': '4a45b34c-d927-4a7e-b71a-fa665269cdc0'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:53 user nova-compute[73052]: INFO os_vif [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=2143778c-ddba-49d1-94fe-ae0a4eb13540,network=Network(66a8815d-7260-4c0c-9068-6ac4fa19888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2143778c-dd')
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:56:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No VIF found with MAC fa:16:3e:e5:8e:10, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:56:54 user nova-compute[73052]: DEBUG nova.network.neutron [req-b824d1ae-6b37-4e07-a06f-9903f800d822 req-7d0eb669-6875-467c-ac18-792c1b692911 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updated VIF entry in instance network info cache for port 2143778c-ddba-49d1-94fe-ae0a4eb13540. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:56:54 user nova-compute[73052]: DEBUG nova.network.neutron [req-b824d1ae-6b37-4e07-a06f-9903f800d822 req-7d0eb669-6875-467c-ac18-792c1b692911 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updating instance_info_cache with network_info: [{"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b824d1ae-6b37-4e07-a06f-9903f800d822 req-7d0eb669-6875-467c-ac18-792c1b692911 service nova] Releasing lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:56:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:56:55 user nova-compute[73052]: INFO nova.compute.claims [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Claim successful on node user
Aug 26 14:56:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.network.neutron [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:56:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.policy [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57f5f67238404fb9954260ad90a0a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7051da8614456b9334b146fa3581fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:56:56 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Creating image(s)
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "/opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "/opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "/opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061801.660345, eb6033f4-da59-4900-a67f-1e244631f046 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:56:56 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: eb6033f4-da59-4900-a67f-1e244631f046] VM Stopped (Lifecycle Event)
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.216s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ac010345-9318-4ea3-aa35-3b0c5bd10611 None None] [instance: eb6033f4-da59-4900-a67f-1e244631f046] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk 1073741824" returned: 0 in 0.055s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Successfully created port: 07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Cannot resize image /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Ensure instance console log exists: /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061817.380754, 4a45b34c-d927-4a7e-b71a-fa665269cdc0 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:56:57 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] VM Resumed (Lifecycle Event)
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:56:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Instance spawned successfully.
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:56:57 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061817.3813846, 4a45b34c-d927-4a7e-b71a-fa665269cdc0 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:56:57 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] VM Started (Lifecycle Event)
Aug 26 14:56:57 user nova-compute[73052]: INFO nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:56:57 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:56:57 user nova-compute[73052]: INFO nova.compute.manager [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Took 6.51 seconds to build instance.
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-58bab7f4-c103-4a80-9c14-7c526f08e529 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.617s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Successfully updated port: 07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquired lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-45ef37d9-33c8-40cd-9c67-1f23623ea7e7 req-c1863d58-27db-4681-8d6e-054771104177 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received event network-changed-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-45ef37d9-33c8-40cd-9c67-1f23623ea7e7 req-c1863d58-27db-4681-8d6e-054771104177 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Refreshing instance network info cache due to event network-changed-07a897a7-343c-42ba-a653-15bbcd053368. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:56:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-45ef37d9-33c8-40cd-9c67-1f23623ea7e7 req-c1863d58-27db-4681-8d6e-054771104177 service nova] Acquiring lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.network.neutron [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Releasing lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Instance network_info: |[{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-45ef37d9-33c8-40cd-9c67-1f23623ea7e7 req-c1863d58-27db-4681-8d6e-054771104177 service nova] Acquired lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-45ef37d9-33c8-40cd-9c67-1f23623ea7e7 req-c1863d58-27db-4681-8d6e-054771104177 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Refreshing network info cache for port 07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Start _get_guest_xml network_info=[{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:56:58 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:56:58 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1171091425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1171091425',id=34,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-1lz8t7js',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:56:56Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=35013e14-c22c-439a-923f-61b1b98ce6b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fc:f3,bridge_name='br-int',has_traffic_filtering=True,id=07a897a7-343c-42ba-a653-15bbcd053368,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a897a7-34') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.objects.instance [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'pci_devices' on Instance uuid 35013e14-c22c-439a-923f-61b1b98ce6b8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:56:58 user nova-compute[73052]:   <uuid>35013e14-c22c-439a-923f-61b1b98ce6b8</uuid>
Aug 26 14:56:58 user nova-compute[73052]:   <name>instance-00000022</name>
Aug 26 14:56:58 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:56:58 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:56:58 user nova-compute[73052]:   <metadata>
Aug 26 14:56:58 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:56:58 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:56:58 user nova-compute[73052]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1171091425</nova:name>
Aug 26 14:56:58 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:56:58</nova:creationTime>
Aug 26 14:56:58 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:56:58 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:56:58 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:56:58 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:56:58 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:56:58 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:56:58 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:56:58 user nova-compute[73052]:       <nova:owner>
Aug 26 14:56:58 user nova-compute[73052]:         <nova:user uuid="57f5f67238404fb9954260ad90a0a96d">tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member</nova:user>
Aug 26 14:56:58 user nova-compute[73052]:         <nova:project uuid="fe7051da8614456b9334b146fa3581fd">tempest-ServerBootFromVolumeStableRescueTest-505611186</nova:project>
Aug 26 14:56:58 user nova-compute[73052]:       </nova:owner>
Aug 26 14:56:58 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:56:58 user nova-compute[73052]:       <nova:ports>
Aug 26 14:56:58 user nova-compute[73052]:         <nova:port uuid="07a897a7-343c-42ba-a653-15bbcd053368">
Aug 26 14:56:58 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 14:56:58 user nova-compute[73052]:         </nova:port>
Aug 26 14:56:58 user nova-compute[73052]:       </nova:ports>
Aug 26 14:56:58 user nova-compute[73052]:     </nova:instance>
Aug 26 14:56:58 user nova-compute[73052]:   </metadata>
Aug 26 14:56:58 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:56:58 user nova-compute[73052]:     <system>
Aug 26 14:56:58 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:56:58 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:56:58 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:56:58 user nova-compute[73052]:       <entry name="serial">35013e14-c22c-439a-923f-61b1b98ce6b8</entry>
Aug 26 14:56:58 user nova-compute[73052]:       <entry name="uuid">35013e14-c22c-439a-923f-61b1b98ce6b8</entry>
Aug 26 14:56:58 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:56:58 user nova-compute[73052]:     </system>
Aug 26 14:56:58 user nova-compute[73052]:   </sysinfo>
Aug 26 14:56:58 user nova-compute[73052]:   <os>
Aug 26 14:56:58 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:56:58 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:56:58 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:56:58 user nova-compute[73052]:   </os>
Aug 26 14:56:58 user nova-compute[73052]:   <features>
Aug 26 14:56:58 user nova-compute[73052]:     <acpi/>
Aug 26 14:56:58 user nova-compute[73052]:     <apic/>
Aug 26 14:56:58 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:56:58 user nova-compute[73052]:   </features>
Aug 26 14:56:58 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:56:58 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:56:58 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:56:58 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:56:58 user nova-compute[73052]:   </clock>
Aug 26 14:56:58 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:56:58 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:56:58 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:56:58 user nova-compute[73052]:   </cpu>
Aug 26 14:56:58 user nova-compute[73052]:   <devices>
Aug 26 14:56:58 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:56:58 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:56:58 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk"/>
Aug 26 14:56:58 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:56:58 user nova-compute[73052]:     </disk>
Aug 26 14:56:58 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:56:58 user nova-compute[73052]:       <mac address="fa:16:3e:0a:fc:f3"/>
Aug 26 14:56:58 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:56:58 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:56:58 user nova-compute[73052]:       <target dev="tap07a897a7-34"/>
Aug 26 14:56:58 user nova-compute[73052]:     </interface>
Aug 26 14:56:58 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:56:58 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/console.log" append="off"/>
Aug 26 14:56:58 user nova-compute[73052]:     </serial>
Aug 26 14:56:58 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:56:58 user nova-compute[73052]:     <video>
Aug 26 14:56:58 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:56:58 user nova-compute[73052]:     </video>
Aug 26 14:56:58 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:56:58 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:56:58 user nova-compute[73052]:     </rng>
Aug 26 14:56:58 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:56:58 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:56:58 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:56:58 user nova-compute[73052]:     </memballoon>
Aug 26 14:56:58 user nova-compute[73052]:   </devices>
Aug 26 14:56:58 user nova-compute[73052]: </domain>
Aug 26 14:56:58 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1171091425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1171091425',id=34,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-1lz8t7js',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:56:56Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=35013e14-c22c-439a-923f-61b1b98ce6b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fc:f3,bridge_name='br-int',has_traffic_filtering=True,id=07a897a7-343c-42ba-a653-15bbcd053368,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a897a7-34') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG os_vif [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fc:f3,bridge_name='br-int',has_traffic_filtering=True,id=07a897a7-343c-42ba-a653-15bbcd053368,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a897a7-34') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07a897a7-34, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07a897a7-34, col_values=(('external_ids', {'iface-id': '07a897a7-343c-42ba-a653-15bbcd053368', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:fc:f3', 'vm-uuid': '35013e14-c22c-439a-923f-61b1b98ce6b8'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:58 user nova-compute[73052]: INFO os_vif [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fc:f3,bridge_name='br-int',has_traffic_filtering=True,id=07a897a7-343c-42ba-a653-15bbcd053368,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a897a7-34')
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No VIF found with MAC fa:16:3e:0a:fc:f3, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-45ef37d9-33c8-40cd-9c67-1f23623ea7e7 req-c1863d58-27db-4681-8d6e-054771104177 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updated VIF entry in instance network info cache for port 07a897a7-343c-42ba-a653-15bbcd053368. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG nova.network.neutron [req-45ef37d9-33c8-40cd-9c67-1f23623ea7e7 req-c1863d58-27db-4681-8d6e-054771104177 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:56:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-45ef37d9-33c8-40cd-9c67-1f23623ea7e7 req-c1863d58-27db-4681-8d6e-054771104177 service nova] Releasing lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:56:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:56:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-2b330dee-af99-4f57-96b0-69bb348c70c4 req-d4a97f8d-f00c-448f-ac74-9e5b3c717409 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received event network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2b330dee-af99-4f57-96b0-69bb348c70c4 req-d4a97f8d-f00c-448f-ac74-9e5b3c717409 service nova] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2b330dee-af99-4f57-96b0-69bb348c70c4 req-d4a97f8d-f00c-448f-ac74-9e5b3c717409 service nova] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2b330dee-af99-4f57-96b0-69bb348c70c4 req-d4a97f8d-f00c-448f-ac74-9e5b3c717409 service nova] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-2b330dee-af99-4f57-96b0-69bb348c70c4 req-d4a97f8d-f00c-448f-ac74-9e5b3c717409 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] No waiting events found dispatching network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:01 user nova-compute[73052]: WARNING nova.compute.manager [req-2b330dee-af99-4f57-96b0-69bb348c70c4 req-d4a97f8d-f00c-448f-ac74-9e5b3c717409 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received unexpected event network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 for instance with vm_state active and task_state None.
Aug 26 14:57:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061822.3998148, 35013e14-c22c-439a-923f-61b1b98ce6b8 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:57:02 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] VM Resumed (Lifecycle Event)
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:57:02 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Instance spawned successfully.
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:57:02 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061822.4032166, 35013e14-c22c-439a-923f-61b1b98ce6b8 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:57:02 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] VM Started (Lifecycle Event)
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:57:02 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:57:02 user nova-compute[73052]: INFO nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Took 6.16 seconds to spawn the instance on the hypervisor.
Aug 26 14:57:02 user nova-compute[73052]: DEBUG nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:57:02 user nova-compute[73052]: INFO nova.compute.manager [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Took 6.95 seconds to build instance.
Aug 26 14:57:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-91da0769-2734-4993-8263-c48808ed5bae tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.088s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received event network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] No waiting events found dispatching network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:03 user nova-compute[73052]: WARNING nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received unexpected event network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 for instance with vm_state active and task_state None.
Aug 26 14:57:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received event network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] No waiting events found dispatching network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:03 user nova-compute[73052]: WARNING nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received unexpected event network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 for instance with vm_state active and task_state None.
Aug 26 14:57:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received event network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] No waiting events found dispatching network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:03 user nova-compute[73052]: WARNING nova.compute.manager [req-3d47ed9a-88ea-4497-8973-0b704a4f7089 req-7ead7a5e-d058-444e-b0e9-4288b89b7fe2 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received unexpected event network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 for instance with vm_state active and task_state None.
Aug 26 14:57:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:57:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:57:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:57:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:57:04 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:57:04 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:57:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:05 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [{"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:57:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:57:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:57:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:13 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:57:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:17 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:57:17 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7633MB free_disk=25.204147338867188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d8fbdddb-dece-4881-bf03-96040e3c731d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:57:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:57:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:57:19 user nova-compute[73052]: INFO nova.compute.claims [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Claim successful on node user
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:57:19 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.policy [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2625163eb644872b43a7914dcca366b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfbc7f8018b4fd29aa4a2f246a85c11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:57:19 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Creating image(s)
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "/opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "/opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "/opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.194s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.246s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk 1073741824" returned: 0 in 0.050s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Successfully created port: 7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Cannot resize image /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Ensure instance console log exists: /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Successfully updated port: 7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquired lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-d1975d48-96a6-47f3-9e3c-0fdba7b41eb1 req-17f368d7-0450-4319-8304-fbb60284683d service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-changed-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-d1975d48-96a6-47f3-9e3c-0fdba7b41eb1 req-17f368d7-0450-4319-8304-fbb60284683d service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Refreshing instance network info cache due to event network-changed-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1975d48-96a6-47f3-9e3c-0fdba7b41eb1 req-17f368d7-0450-4319-8304-fbb60284683d service nova] Acquiring lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updating instance_info_cache with network_info: [{"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Releasing lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Instance network_info: |[{"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1975d48-96a6-47f3-9e3c-0fdba7b41eb1 req-17f368d7-0450-4319-8304-fbb60284683d service nova] Acquired lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-d1975d48-96a6-47f3-9e3c-0fdba7b41eb1 req-17f368d7-0450-4319-8304-fbb60284683d service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Refreshing network info cache for port 7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Start _get_guest_xml network_info=[{"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:57:21 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:57:21 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1910020289',display_name='tempest-TestStampPattern-server-1910020289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1910020289',id=35,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQexKIMfesKSv2hoelfaNzG2QIHClVDFpvVqLXF9gD62XnTHDVnS3avo8uiqbd9zSMsB18mkPPWxAFIuiGViQSleqODN9ZqAbPTDcng8pgHyinnPi9agAubqw/jrXpO7g==',key_name='tempest-TestStampPattern-1713822412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfbc7f8018b4fd29aa4a2f246a85c11',ramdisk_id='',reservation_id='r-gdupajo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1398027688',owner_user_name='tempest-TestStampPattern-1398027688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:57:20Z,user_data=None,user_id='d2625163eb644872b43a7914dcca366b',uuid=de1ab010-f0e3-48c7-bc42-b2bb5746cc13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converting VIF {"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:30:59,bridge_name='br-int',has_traffic_filtering=True,id=7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fd0c3-fe') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'pci_devices' on Instance uuid de1ab010-f0e3-48c7-bc42-b2bb5746cc13 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:57:21 user nova-compute[73052]:   <uuid>de1ab010-f0e3-48c7-bc42-b2bb5746cc13</uuid>
Aug 26 14:57:21 user nova-compute[73052]:   <name>instance-00000023</name>
Aug 26 14:57:21 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:57:21 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:57:21 user nova-compute[73052]:   <metadata>
Aug 26 14:57:21 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:57:21 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:57:21 user nova-compute[73052]:       <nova:name>tempest-TestStampPattern-server-1910020289</nova:name>
Aug 26 14:57:21 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:57:21</nova:creationTime>
Aug 26 14:57:21 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:57:21 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:57:21 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:57:21 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:57:21 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:57:21 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:57:21 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:57:21 user nova-compute[73052]:       <nova:owner>
Aug 26 14:57:21 user nova-compute[73052]:         <nova:user uuid="d2625163eb644872b43a7914dcca366b">tempest-TestStampPattern-1398027688-project-member</nova:user>
Aug 26 14:57:21 user nova-compute[73052]:         <nova:project uuid="8dfbc7f8018b4fd29aa4a2f246a85c11">tempest-TestStampPattern-1398027688</nova:project>
Aug 26 14:57:21 user nova-compute[73052]:       </nova:owner>
Aug 26 14:57:21 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:57:21 user nova-compute[73052]:       <nova:ports>
Aug 26 14:57:21 user nova-compute[73052]:         <nova:port uuid="7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0">
Aug 26 14:57:21 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 14:57:21 user nova-compute[73052]:         </nova:port>
Aug 26 14:57:21 user nova-compute[73052]:       </nova:ports>
Aug 26 14:57:21 user nova-compute[73052]:     </nova:instance>
Aug 26 14:57:21 user nova-compute[73052]:   </metadata>
Aug 26 14:57:21 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:57:21 user nova-compute[73052]:     <system>
Aug 26 14:57:21 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:57:21 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:57:21 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:57:21 user nova-compute[73052]:       <entry name="serial">de1ab010-f0e3-48c7-bc42-b2bb5746cc13</entry>
Aug 26 14:57:21 user nova-compute[73052]:       <entry name="uuid">de1ab010-f0e3-48c7-bc42-b2bb5746cc13</entry>
Aug 26 14:57:21 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:57:21 user nova-compute[73052]:     </system>
Aug 26 14:57:21 user nova-compute[73052]:   </sysinfo>
Aug 26 14:57:21 user nova-compute[73052]:   <os>
Aug 26 14:57:21 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:57:21 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:57:21 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:57:21 user nova-compute[73052]:   </os>
Aug 26 14:57:21 user nova-compute[73052]:   <features>
Aug 26 14:57:21 user nova-compute[73052]:     <acpi/>
Aug 26 14:57:21 user nova-compute[73052]:     <apic/>
Aug 26 14:57:21 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:57:21 user nova-compute[73052]:   </features>
Aug 26 14:57:21 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:57:21 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:57:21 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:57:21 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:57:21 user nova-compute[73052]:   </clock>
Aug 26 14:57:21 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:57:21 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:57:21 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:57:21 user nova-compute[73052]:   </cpu>
Aug 26 14:57:21 user nova-compute[73052]:   <devices>
Aug 26 14:57:21 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:57:21 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:57:21 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk"/>
Aug 26 14:57:21 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:57:21 user nova-compute[73052]:     </disk>
Aug 26 14:57:21 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:57:21 user nova-compute[73052]:       <mac address="fa:16:3e:eb:30:59"/>
Aug 26 14:57:21 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:57:21 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:57:21 user nova-compute[73052]:       <target dev="tap7d9fd0c3-fe"/>
Aug 26 14:57:21 user nova-compute[73052]:     </interface>
Aug 26 14:57:21 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:57:21 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/console.log" append="off"/>
Aug 26 14:57:21 user nova-compute[73052]:     </serial>
Aug 26 14:57:21 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:57:21 user nova-compute[73052]:     <video>
Aug 26 14:57:21 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:57:21 user nova-compute[73052]:     </video>
Aug 26 14:57:21 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:57:21 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:57:21 user nova-compute[73052]:     </rng>
Aug 26 14:57:21 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:57:21 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:57:21 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:57:21 user nova-compute[73052]:     </memballoon>
Aug 26 14:57:21 user nova-compute[73052]:   </devices>
Aug 26 14:57:21 user nova-compute[73052]: </domain>
Aug 26 14:57:21 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1910020289',display_name='tempest-TestStampPattern-server-1910020289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1910020289',id=35,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQexKIMfesKSv2hoelfaNzG2QIHClVDFpvVqLXF9gD62XnTHDVnS3avo8uiqbd9zSMsB18mkPPWxAFIuiGViQSleqODN9ZqAbPTDcng8pgHyinnPi9agAubqw/jrXpO7g==',key_name='tempest-TestStampPattern-1713822412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfbc7f8018b4fd29aa4a2f246a85c11',ramdisk_id='',reservation_id='r-gdupajo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1398027688',owner_user_name='tempest-TestStampPattern-1398027688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:57:20Z,user_data=None,user_id='d2625163eb644872b43a7914dcca366b',uuid=de1ab010-f0e3-48c7-bc42-b2bb5746cc13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converting VIF {"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:30:59,bridge_name='br-int',has_traffic_filtering=True,id=7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fd0c3-fe') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG os_vif [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:30:59,bridge_name='br-int',has_traffic_filtering=True,id=7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fd0c3-fe') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d9fd0c3-fe, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d9fd0c3-fe, col_values=(('external_ids', {'iface-id': '7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:30:59', 'vm-uuid': 'de1ab010-f0e3-48c7-bc42-b2bb5746cc13'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:21 user nova-compute[73052]: INFO os_vif [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:30:59,bridge_name='br-int',has_traffic_filtering=True,id=7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fd0c3-fe')
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:57:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No VIF found with MAC fa:16:3e:eb:30:59, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:57:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-d1975d48-96a6-47f3-9e3c-0fdba7b41eb1 req-17f368d7-0450-4319-8304-fbb60284683d service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updated VIF entry in instance network info cache for port 7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:57:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-d1975d48-96a6-47f3-9e3c-0fdba7b41eb1 req-17f368d7-0450-4319-8304-fbb60284683d service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updating instance_info_cache with network_info: [{"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d1975d48-96a6-47f3-9e3c-0fdba7b41eb1 req-17f368d7-0450-4319-8304-fbb60284683d service nova] Releasing lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-3a4e73f1-9a01-4498-a4b5-5c4237798878 req-c102d224-85b0-488f-acca-bdf17e543f48 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3a4e73f1-9a01-4498-a4b5-5c4237798878 req-c102d224-85b0-488f-acca-bdf17e543f48 service nova] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3a4e73f1-9a01-4498-a4b5-5c4237798878 req-c102d224-85b0-488f-acca-bdf17e543f48 service nova] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3a4e73f1-9a01-4498-a4b5-5c4237798878 req-c102d224-85b0-488f-acca-bdf17e543f48 service nova] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-3a4e73f1-9a01-4498-a4b5-5c4237798878 req-c102d224-85b0-488f-acca-bdf17e543f48 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] No waiting events found dispatching network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:23 user nova-compute[73052]: WARNING nova.compute.manager [req-3a4e73f1-9a01-4498-a4b5-5c4237798878 req-c102d224-85b0-488f-acca-bdf17e543f48 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received unexpected event network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 for instance with vm_state building and task_state spawning.
Aug 26 14:57:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061845.414397, de1ab010-f0e3-48c7-bc42-b2bb5746cc13 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:57:25 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] VM Resumed (Lifecycle Event)
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:57:25 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Instance spawned successfully.
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:57:25 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061845.414797, de1ab010-f0e3-48c7-bc42-b2bb5746cc13 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:57:25 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] VM Started (Lifecycle Event)
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:57:25 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:57:25 user nova-compute[73052]: INFO nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.compute.manager [req-eeb863c9-e060-435b-b14a-5452000bd26a req-317ec99f-c3f5-4777-b4f1-83b44f9ccb15 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eeb863c9-e060-435b-b14a-5452000bd26a req-317ec99f-c3f5-4777-b4f1-83b44f9ccb15 service nova] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eeb863c9-e060-435b-b14a-5452000bd26a req-317ec99f-c3f5-4777-b4f1-83b44f9ccb15 service nova] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-eeb863c9-e060-435b-b14a-5452000bd26a req-317ec99f-c3f5-4777-b4f1-83b44f9ccb15 service nova] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:25 user nova-compute[73052]: DEBUG nova.compute.manager [req-eeb863c9-e060-435b-b14a-5452000bd26a req-317ec99f-c3f5-4777-b4f1-83b44f9ccb15 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] No waiting events found dispatching network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:25 user nova-compute[73052]: WARNING nova.compute.manager [req-eeb863c9-e060-435b-b14a-5452000bd26a req-317ec99f-c3f5-4777-b4f1-83b44f9ccb15 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received unexpected event network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 for instance with vm_state building and task_state spawning.
Aug 26 14:57:25 user nova-compute[73052]: INFO nova.compute.manager [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Took 6.67 seconds to build instance.
Aug 26 14:57:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c81dbd9a-432e-45ef-9c17-28715fcfedf3 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.820s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-dafdd687-1fc4-4cd5-9234-6448c5a7741d req-70b5ef93-ab19-4fbc-a510-bcb9ebf185b7 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received event network-changed-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-dafdd687-1fc4-4cd5-9234-6448c5a7741d req-70b5ef93-ab19-4fbc-a510-bcb9ebf185b7 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Refreshing instance network info cache due to event network-changed-71ce5d69-db9a-4e03-b4de-481296af5e31. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dafdd687-1fc4-4cd5-9234-6448c5a7741d req-70b5ef93-ab19-4fbc-a510-bcb9ebf185b7 service nova] Acquiring lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dafdd687-1fc4-4cd5-9234-6448c5a7741d req-70b5ef93-ab19-4fbc-a510-bcb9ebf185b7 service nova] Acquired lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG nova.network.neutron [req-dafdd687-1fc4-4cd5-9234-6448c5a7741d req-70b5ef93-ab19-4fbc-a510-bcb9ebf185b7 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Refreshing network info cache for port 71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:30 user nova-compute[73052]: DEBUG nova.objects.instance [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'flavor' on Instance uuid dfec8dbe-de2a-4166-b4a8-4079d7b480c2 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:57:30 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Ignoring supplied device name: /dev/vdb
Aug 26 14:57:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:31 user nova-compute[73052]: INFO nova.compute.manager [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Attaching volume 4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 to /dev/vdb
Aug 26 14:57:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-dafdd687-1fc4-4cd5-9234-6448c5a7741d req-70b5ef93-ab19-4fbc-a510-bcb9ebf185b7 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Updated VIF entry in instance network info cache for port 71ce5d69-db9a-4e03-b4de-481296af5e31. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-dafdd687-1fc4-4cd5-9234-6448c5a7741d req-70b5ef93-ab19-4fbc-a510-bcb9ebf185b7 service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Updating instance_info_cache with network_info: [{"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dafdd687-1fc4-4cd5-9234-6448c5a7741d req-70b5ef93-ab19-4fbc-a510-bcb9ebf185b7 service nova] Releasing lock "refresh_cache-dfec8dbe-de2a-4166-b4a8-4079d7b480c2" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG os_brick.utils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[da312d2e-be94-4fd9-bcbd-465635782b23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ded493-c0e8-46d1-bd19-6f8df598e129]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a770897-2a87-46ec-8623-f7f73652d19f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0c59f-c571-44db-9879-2ba5b74cb6bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:57:31 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e1dbf-2760-4572-90c2-faa4a75bb4ec]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG os_brick.utils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Updating existing volume attachment record: 75e59bd3-aff3-4ab8-87bd-3d51b5dc2ee2 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:31 user nova-compute[73052]: INFO nova.compute.manager [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Terminating instance
Aug 26 14:57:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-c44f567e-c06f-43a5-a797-4ff8d90881ce req-a83e58e7-8634-4bf2-be6d-1190b7f4f55a service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c44f567e-c06f-43a5-a797-4ff8d90881ce req-a83e58e7-8634-4bf2-be6d-1190b7f4f55a service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c44f567e-c06f-43a5-a797-4ff8d90881ce req-a83e58e7-8634-4bf2-be6d-1190b7f4f55a service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c44f567e-c06f-43a5-a797-4ff8d90881ce req-a83e58e7-8634-4bf2-be6d-1190b7f4f55a service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-c44f567e-c06f-43a5-a797-4ff8d90881ce req-a83e58e7-8634-4bf2-be6d-1190b7f4f55a service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-c44f567e-c06f-43a5-a797-4ff8d90881ce req-a83e58e7-8634-4bf2-be6d-1190b7f4f55a service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-unplugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:57:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Instance destroyed successfully.
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lazy-loading 'resources' on Instance uuid 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-306863605',display_name='tempest-ServerRescueNegativeTestJSON-server-306863605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-306863605',id=2,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:44:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6426cc5de72e40e4ba4570304328a568',ramdisk_id='',reservation_id='r-x7v6rmb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2104819576',owner_user_name='tempest-ServerRescueNegativeTestJSON-2104819576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:46:50Z,user_data=None,user_id='966347969be04bb9a69cbdc441a94d8f',uuid=36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converting VIF {"id": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "address": "fa:16:3e:d9:a9:06", "network": {"id": "feb4c655-c4bb-40a0-8893-9b33442a72ba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-686648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6426cc5de72e40e4ba4570304328a568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91967ed-1d", "ovs_interfaceid": "f91967ed-1d90-4f7a-9265-4d13731fa7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:a9:06,bridge_name='br-int',has_traffic_filtering=True,id=f91967ed-1d90-4f7a-9265-4d13731fa7ef,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91967ed-1d') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG os_vif [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:a9:06,bridge_name='br-int',has_traffic_filtering=True,id=f91967ed-1d90-4f7a-9265-4d13731fa7ef,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91967ed-1d') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf91967ed-1d, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:32 user nova-compute[73052]: INFO os_vif [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:a9:06,bridge_name='br-int',has_traffic_filtering=True,id=f91967ed-1d90-4f7a-9265-4d13731fa7ef,network=Network(feb4c655-c4bb-40a0-8893-9b33442a72ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91967ed-1d')
Aug 26 14:57:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Deleting instance files /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749_del
Aug 26 14:57:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Deletion of /opt/stack/data/nova/instances/36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749_del complete
Aug 26 14:57:32 user nova-compute[73052]: INFO nova.compute.manager [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 14:57:32 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-50bb12d9-a231-46e8-a564-c1b0bb2efb0d req-9c56ffe6-d8e6-4f33-a4a8-4a97727c2c0d service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-deleted-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:32 user nova-compute[73052]: INFO nova.compute.manager [req-50bb12d9-a231-46e8-a564-c1b0bb2efb0d req-9c56ffe6-d8e6-4f33-a4a8-4a97727c2c0d service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Neutron deleted interface f91967ed-1d90-4f7a-9265-4d13731fa7ef; detaching it from the instance and deleting it from the info cache
Aug 26 14:57:32 user nova-compute[73052]: DEBUG nova.network.neutron [req-50bb12d9-a231-46e8-a564-c1b0bb2efb0d req-9c56ffe6-d8e6-4f33-a4a8-4a97727c2c0d service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:32 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Took 0.62 seconds to deallocate network for instance.
Aug 26 14:57:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-50bb12d9-a231-46e8-a564-c1b0bb2efb0d req-9c56ffe6-d8e6-4f33-a4a8-4a97727c2c0d service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Detach interface failed, port_id=f91967ed-1d90-4f7a-9265-4d13731fa7ef, reason: Instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:33 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Deleted allocations for instance 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749
Aug 26 14:57:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ed38605c-b379-436d-b599-f68d0600e38a tempest-ServerRescueNegativeTestJSON-2104819576 tempest-ServerRescueNegativeTestJSON-2104819576-project-member] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-57992d48-3e6d-4012-bde7-c05b81b2c781 req-7c8267c5-bc48-431d-90ff-6cf84e699f50 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-57992d48-3e6d-4012-bde7-c05b81b2c781 req-7c8267c5-bc48-431d-90ff-6cf84e699f50 service nova] Acquiring lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-57992d48-3e6d-4012-bde7-c05b81b2c781 req-7c8267c5-bc48-431d-90ff-6cf84e699f50 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-57992d48-3e6d-4012-bde7-c05b81b2c781 req-7c8267c5-bc48-431d-90ff-6cf84e699f50 service nova] Lock "36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-57992d48-3e6d-4012-bde7-c05b81b2c781 req-7c8267c5-bc48-431d-90ff-6cf84e699f50 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] No waiting events found dispatching network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:33 user nova-compute[73052]: WARNING nova.compute.manager [req-57992d48-3e6d-4012-bde7-c05b81b2c781 req-7c8267c5-bc48-431d-90ff-6cf84e699f50 service nova] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Received unexpected event network-vif-plugged-f91967ed-1d90-4f7a-9265-4d13731fa7ef for instance with vm_state deleted and task_state None.
Aug 26 14:57:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "8331e32c-2e11-4bcd-8f31-669ff692688f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:57:35 user nova-compute[73052]: INFO nova.compute.claims [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Claim successful on node user
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:57:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:57:35 user nova-compute[73052]: DEBUG nova.policy [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce6cd78a2f7c407983d90a15ffb94967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8ab154558a4521920e05921722db36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:57:35 user nova-compute[73052]: INFO nova.virt.block_device [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Booting with volume c56e4216-7611-4b65-86aa-66c7e78c46d8 at /dev/vda
Aug 26 14:57:35 user nova-compute[73052]: DEBUG os_brick.utils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc89145-8745-4df9-8130-b61fd684bc58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05d9c90-452d-4497-8566-b3db568b8502]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbbaec0-f76e-4023-8ae9-aed3b8d9ef58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc37ea1-11fd-4361-afdc-69f083c731d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:57:36 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:57:36 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027ef7c-320d-4606-9da0-0d4218df50ef]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG os_brick.utils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Updating existing volume attachment record: c900eb94-d359-4832-97d8-374194497043 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:57:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Successfully created port: b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Successfully updated port: b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquired lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-2be55d72-b01e-485d-9b52-2dc24f5e53db req-d20086c5-ab4f-4a1d-8456-3a21eb854019 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received event network-changed-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-2be55d72-b01e-485d-9b52-2dc24f5e53db req-d20086c5-ab4f-4a1d-8456-3a21eb854019 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Refreshing instance network info cache due to event network-changed-b27b4556-b692-4099-88f9-7519d6c2a6d8. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2be55d72-b01e-485d-9b52-2dc24f5e53db req-d20086c5-ab4f-4a1d-8456-3a21eb854019 service nova] Acquiring lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Updating instance_info_cache with network_info: [{"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Releasing lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Instance network_info: |[{"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2be55d72-b01e-485d-9b52-2dc24f5e53db req-d20086c5-ab4f-4a1d-8456-3a21eb854019 service nova] Acquired lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:57:37 user nova-compute[73052]: DEBUG nova.network.neutron [req-2be55d72-b01e-485d-9b52-2dc24f5e53db req-d20086c5-ab4f-4a1d-8456-3a21eb854019 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Refreshing network info cache for port b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:57:38 user nova-compute[73052]: DEBUG nova.network.neutron [req-2be55d72-b01e-485d-9b52-2dc24f5e53db req-d20086c5-ab4f-4a1d-8456-3a21eb854019 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Updated VIF entry in instance network info cache for port b27b4556-b692-4099-88f9-7519d6c2a6d8. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:57:38 user nova-compute[73052]: DEBUG nova.network.neutron [req-2be55d72-b01e-485d-9b52-2dc24f5e53db req-d20086c5-ab4f-4a1d-8456-3a21eb854019 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Updating instance_info_cache with network_info: [{"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2be55d72-b01e-485d-9b52-2dc24f5e53db req-d20086c5-ab4f-4a1d-8456-3a21eb854019 service nova] Releasing lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:57:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJTXjECr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:57:42 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:57:42 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:57:42 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[354fa69d-5b1e-44b1-a996-c76dfc7d1aae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:57:42 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1ca9c-6a61-41bc-96fe-3ac5f891acb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0] added
Aug 26 14:57:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bf27ee-c3a7-479d-aae1-fc9e6131bc61]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f200866-f8df-49bc-9fb9-c27592057822]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJTXjECr {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJTXjECr" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a58a30-c788-41b0-9d61-e68c7e163d27]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJTXjECr'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fb196f-704f-4065-873a-d8f375440d6c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8feb34c-e2ef-49ae-a371-366eeb5bd261]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[da50eb64-158a-47c9-9e68-c8296eaa5256]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0, portal: 172.16.0.220,3260]
Aug 26 14:57:42 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0, portal: 172.16.0.220,3260] successful.
Aug 26 14:57:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99e35f3-5ab8-4e9f-ac42-ea9a26bfcb0b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2902154-305b-4beb-94aa-fbc788f2020f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:57:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[628bd82e-846a-4830-953f-defb0fe42adb]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:57:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJTXjECr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:57:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:57:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26535363039363166', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:57:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535363039363166', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:57:43 user nova-compute[73052]: DEBUG nova.objects.instance [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'flavor' on Instance uuid dfec8dbe-de2a-4166-b4a8-4079d7b480c2 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:57:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:57:43 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:57:43 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:57:43 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:57:43 user nova-compute[73052]:   <serial>4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0</serial>
Aug 26 14:57:43 user nova-compute[73052]: </disk>
Aug 26 14:57:43 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:57:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:57:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:57:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No VIF found with MAC fa:16:3e:18:1f:1f, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:57:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-63aa102b-0d86-433f-bb9c-65d8161218cb tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.968s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:47 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061852.2700026, 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:57:47 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] VM Stopped (Lifecycle Event)
Aug 26 14:57:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4f6b3e1d-37a7-4573-b7d7-347f0753a9b2 None None] [instance: 36bd5e7e-cf1b-41d1-a50c-0f0a5bf19749] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:57:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:49 user nova-compute[73052]: INFO nova.compute.manager [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Terminating instance
Aug 26 14:57:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-45d3ea4d-5197-40a8-8753-d857e4d95bd7 req-efadf17c-66dc-469f-a6a0-418841808a69 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-unplugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-45d3ea4d-5197-40a8-8753-d857e4d95bd7 req-efadf17c-66dc-469f-a6a0-418841808a69 service nova] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-45d3ea4d-5197-40a8-8753-d857e4d95bd7 req-efadf17c-66dc-469f-a6a0-418841808a69 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-45d3ea4d-5197-40a8-8753-d857e4d95bd7 req-efadf17c-66dc-469f-a6a0-418841808a69 service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-45d3ea4d-5197-40a8-8753-d857e4d95bd7 req-efadf17c-66dc-469f-a6a0-418841808a69 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] No waiting events found dispatching network-vif-unplugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-45d3ea4d-5197-40a8-8753-d857e4d95bd7 req-efadf17c-66dc-469f-a6a0-418841808a69 service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-unplugged-3fc35180-bc12-4f46-a612-6d51786c0780 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:57:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Instance destroyed successfully.
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lazy-loading 'resources' on Instance uuid de3630fa-98b3-4a5a-b008-e98f0c72d0ea {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-40607858',display_name='tempest-TestMinimumBasicScenario-server-40607858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-40607858',id=28,image_ref='9b70267c-3338-42a0-9017-bc3de23f25d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0DFrLcI+1d0Nt4ub5zsk8f2QHPukBYSTOYI/xQk/oNL+lfo/7i+kft7UHe2b8HK2rHrbKUPoRTkRaQzwoLAbY11jn27IxE1hJ5EKM2gnqu/if5EckzgGfJB8bMZ36hWw==',key_name='tempest-TestMinimumBasicScenario-1581449756',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:52:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7454d6d00cc4165b90d29aeea11067b',ramdisk_id='',reservation_id='r-1a8i8qhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9b70267c-3338-42a0-9017-bc3de23f25d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1910985391',owner_user_name='tempest-TestMinimumBasicScenario-1910985391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:55:04Z,user_data=None,user_id='c5477383284f46df97949c64f6cc0021',uuid=de3630fa-98b3-4a5a-b008-e98f0c72d0ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converting VIF {"id": "3fc35180-bc12-4f46-a612-6d51786c0780", "address": "fa:16:3e:41:a9:f3", "network": {"id": "5ba4779f-4614-452c-8b9a-7ef8c8b5ed58", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1493415724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7454d6d00cc4165b90d29aeea11067b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc35180-bc", "ovs_interfaceid": "3fc35180-bc12-4f46-a612-6d51786c0780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:a9:f3,bridge_name='br-int',has_traffic_filtering=True,id=3fc35180-bc12-4f46-a612-6d51786c0780,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc35180-bc') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG os_vif [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:a9:f3,bridge_name='br-int',has_traffic_filtering=True,id=3fc35180-bc12-4f46-a612-6d51786c0780,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc35180-bc') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fc35180-bc, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:57:50 user nova-compute[73052]: INFO os_vif [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:a9:f3,bridge_name='br-int',has_traffic_filtering=True,id=3fc35180-bc12-4f46-a612-6d51786c0780,network=Network(5ba4779f-4614-452c-8b9a-7ef8c8b5ed58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc35180-bc')
Aug 26 14:57:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Deleting instance files /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea_del
Aug 26 14:57:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Deletion of /opt/stack/data/nova/instances/de3630fa-98b3-4a5a-b008-e98f0c72d0ea_del complete
Aug 26 14:57:50 user nova-compute[73052]: INFO nova.compute.manager [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 26 14:57:50 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:57:50 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:57:51 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:57:51 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Took 0.70 seconds to deallocate network for instance.
Aug 26 14:57:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:51 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:57:52 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:57:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:52 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Deleted allocations for instance de3630fa-98b3-4a5a-b008-e98f0c72d0ea
Aug 26 14:57:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8c52b19-6e55-47a0-8d5d-38be21d9ab42 tempest-TestMinimumBasicScenario-1910985391 tempest-TestMinimumBasicScenario-1910985391-project-member] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.401s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-5790822e-3cee-4bd0-a1cf-e27115eddb96 req-6841343e-c002-4672-93a8-0ebe0ca0f2ff service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5790822e-3cee-4bd0-a1cf-e27115eddb96 req-6841343e-c002-4672-93a8-0ebe0ca0f2ff service nova] Acquiring lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:57:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5790822e-3cee-4bd0-a1cf-e27115eddb96 req-6841343e-c002-4672-93a8-0ebe0ca0f2ff service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:57:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5790822e-3cee-4bd0-a1cf-e27115eddb96 req-6841343e-c002-4672-93a8-0ebe0ca0f2ff service nova] Lock "de3630fa-98b3-4a5a-b008-e98f0c72d0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:57:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-5790822e-3cee-4bd0-a1cf-e27115eddb96 req-6841343e-c002-4672-93a8-0ebe0ca0f2ff service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] No waiting events found dispatching network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:57:52 user nova-compute[73052]: WARNING nova.compute.manager [req-5790822e-3cee-4bd0-a1cf-e27115eddb96 req-6841343e-c002-4672-93a8-0ebe0ca0f2ff service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received unexpected event network-vif-plugged-3fc35180-bc12-4f46-a612-6d51786c0780 for instance with vm_state deleted and task_state None.
Aug 26 14:57:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-5790822e-3cee-4bd0-a1cf-e27115eddb96 req-6841343e-c002-4672-93a8-0ebe0ca0f2ff service nova] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Received event network-vif-deleted-3fc35180-bc12-4f46-a612-6d51786c0780 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:57:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:57:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:57:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:57:59 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Creating image(s)
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Ensure instance console log exists: /opt/stack/data/nova/instances/8331e32c-2e11-4bcd-8f31-669ff692688f/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Start _get_guest_xml network_info=[{"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'c900eb94-d359-4832-97d8-374194497043', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlHjJTwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8331e32c-2e11-4bcd-8f31-669ff692688f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c56e4216-7611-4b65-86aa-66c7e78c46d8', 'serial': 'c56e4216-7611-4b65-86aa-66c7e78c46d8'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:58:00 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:58:00 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlHjJTwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:58:00 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:58:00 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:58:00 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8a4d72-528b-442a-9698-4dd30908525c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:58:00 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece649a-7d70-4559-91f3-256e6bf8a730]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8] added
Aug 26 14:58:00 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dda749-f618-44ba-9680-d6407f431ffd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23ca150-2313-496b-8e31-2640c1aa6860]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlHjJTwa {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlHjJTwa" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4b664b-0822-48f0-b05d-85fc90e736a9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlHjJTwa'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[89925b71-0ca8-4765-8709-b7e5f4f50060]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7001f93a-e83b-44dc-b8fa-6eecee80672f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49e49b9-e615-414c-a46f-956087e48667]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260]
Aug 26 14:58:00 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260] successful.
Aug 26 14:58:00 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab167b1-e631-4ae0-a1d0-de556af43a5b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9ed435-522d-4ed3-885b-f47beb2ebec5]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c418cb-6d46-41c2-a6bb-bb221c196389 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:58:00 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3eaef8-d4f4-4b8f-9da5-6137bc98a374]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:58:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlHjJTwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23161303738333733', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161303738333733', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1283644084',display_name='tempest-TestVolumeBootPattern-server-1283644084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1283644084',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-zt71lby5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:57:36Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=8331e32c-2e11-4bcd-8f31-669ff692688f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:51:81,bridge_name='br-int',has_traffic_filtering=True,id=b27b4556-b692-4099-88f9-7519d6c2a6d8,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb27b4556-b6') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'pci_devices' on Instance uuid 8331e32c-2e11-4bcd-8f31-669ff692688f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:58:01 user nova-compute[73052]:   <uuid>8331e32c-2e11-4bcd-8f31-669ff692688f</uuid>
Aug 26 14:58:01 user nova-compute[73052]:   <name>instance-00000024</name>
Aug 26 14:58:01 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:58:01 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:58:01 user nova-compute[73052]:   <metadata>
Aug 26 14:58:01 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:58:01 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:58:01 user nova-compute[73052]:       <nova:name>tempest-TestVolumeBootPattern-server-1283644084</nova:name>
Aug 26 14:58:01 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:58:00</nova:creationTime>
Aug 26 14:58:01 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:58:01 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:58:01 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:58:01 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:58:01 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:58:01 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:58:01 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:58:01 user nova-compute[73052]:       <nova:owner>
Aug 26 14:58:01 user nova-compute[73052]:         <nova:user uuid="ce6cd78a2f7c407983d90a15ffb94967">tempest-TestVolumeBootPattern-772605316-project-member</nova:user>
Aug 26 14:58:01 user nova-compute[73052]:         <nova:project uuid="1e8ab154558a4521920e05921722db36">tempest-TestVolumeBootPattern-772605316</nova:project>
Aug 26 14:58:01 user nova-compute[73052]:       </nova:owner>
Aug 26 14:58:01 user nova-compute[73052]:       <nova:ports>
Aug 26 14:58:01 user nova-compute[73052]:         <nova:port uuid="b27b4556-b692-4099-88f9-7519d6c2a6d8">
Aug 26 14:58:01 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 14:58:01 user nova-compute[73052]:         </nova:port>
Aug 26 14:58:01 user nova-compute[73052]:       </nova:ports>
Aug 26 14:58:01 user nova-compute[73052]:     </nova:instance>
Aug 26 14:58:01 user nova-compute[73052]:   </metadata>
Aug 26 14:58:01 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:58:01 user nova-compute[73052]:     <system>
Aug 26 14:58:01 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:58:01 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:58:01 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:58:01 user nova-compute[73052]:       <entry name="serial">8331e32c-2e11-4bcd-8f31-669ff692688f</entry>
Aug 26 14:58:01 user nova-compute[73052]:       <entry name="uuid">8331e32c-2e11-4bcd-8f31-669ff692688f</entry>
Aug 26 14:58:01 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:58:01 user nova-compute[73052]:     </system>
Aug 26 14:58:01 user nova-compute[73052]:   </sysinfo>
Aug 26 14:58:01 user nova-compute[73052]:   <os>
Aug 26 14:58:01 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:58:01 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:58:01 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:58:01 user nova-compute[73052]:   </os>
Aug 26 14:58:01 user nova-compute[73052]:   <features>
Aug 26 14:58:01 user nova-compute[73052]:     <acpi/>
Aug 26 14:58:01 user nova-compute[73052]:     <apic/>
Aug 26 14:58:01 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:58:01 user nova-compute[73052]:   </features>
Aug 26 14:58:01 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:58:01 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:58:01 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:58:01 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:58:01 user nova-compute[73052]:   </clock>
Aug 26 14:58:01 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:58:01 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:58:01 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:58:01 user nova-compute[73052]:   </cpu>
Aug 26 14:58:01 user nova-compute[73052]:   <devices>
Aug 26 14:58:01 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 14:58:01 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:58:01 user nova-compute[73052]:       <source dev="/dev/sde"/>
Aug 26 14:58:01 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:58:01 user nova-compute[73052]:       <serial>c56e4216-7611-4b65-86aa-66c7e78c46d8</serial>
Aug 26 14:58:01 user nova-compute[73052]:     </disk>
Aug 26 14:58:01 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:58:01 user nova-compute[73052]:       <mac address="fa:16:3e:77:51:81"/>
Aug 26 14:58:01 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:58:01 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:58:01 user nova-compute[73052]:       <target dev="tapb27b4556-b6"/>
Aug 26 14:58:01 user nova-compute[73052]:     </interface>
Aug 26 14:58:01 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:58:01 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/8331e32c-2e11-4bcd-8f31-669ff692688f/console.log" append="off"/>
Aug 26 14:58:01 user nova-compute[73052]:     </serial>
Aug 26 14:58:01 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:58:01 user nova-compute[73052]:     <video>
Aug 26 14:58:01 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:58:01 user nova-compute[73052]:     </video>
Aug 26 14:58:01 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:58:01 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:58:01 user nova-compute[73052]:     </rng>
Aug 26 14:58:01 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:58:01 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:58:01 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:58:01 user nova-compute[73052]:     </memballoon>
Aug 26 14:58:01 user nova-compute[73052]:   </devices>
Aug 26 14:58:01 user nova-compute[73052]: </domain>
Aug 26 14:58:01 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1283644084',display_name='tempest-TestVolumeBootPattern-server-1283644084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1283644084',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-zt71lby5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:57:36Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=8331e32c-2e11-4bcd-8f31-669ff692688f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:51:81,bridge_name='br-int',has_traffic_filtering=True,id=b27b4556-b692-4099-88f9-7519d6c2a6d8,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb27b4556-b6') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG os_vif [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:51:81,bridge_name='br-int',has_traffic_filtering=True,id=b27b4556-b692-4099-88f9-7519d6c2a6d8,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb27b4556-b6') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb27b4556-b6, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb27b4556-b6, col_values=(('external_ids', {'iface-id': 'b27b4556-b692-4099-88f9-7519d6c2a6d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:51:81', 'vm-uuid': '8331e32c-2e11-4bcd-8f31-669ff692688f'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:01 user nova-compute[73052]: INFO os_vif [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:51:81,bridge_name='br-int',has_traffic_filtering=True,id=b27b4556-b692-4099-88f9-7519d6c2a6d8,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb27b4556-b6')
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:58:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No VIF found with MAC fa:16:3e:77:51:81, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:58:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-62c9c95b-d753-4075-90df-75ee9c2af6dd req-c8a73869-1b57-44ce-ab87-48e50a326ff8 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received event network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62c9c95b-d753-4075-90df-75ee9c2af6dd req-c8a73869-1b57-44ce-ab87-48e50a326ff8 service nova] Acquiring lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62c9c95b-d753-4075-90df-75ee9c2af6dd req-c8a73869-1b57-44ce-ab87-48e50a326ff8 service nova] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62c9c95b-d753-4075-90df-75ee9c2af6dd req-c8a73869-1b57-44ce-ab87-48e50a326ff8 service nova] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-62c9c95b-d753-4075-90df-75ee9c2af6dd req-c8a73869-1b57-44ce-ab87-48e50a326ff8 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] No waiting events found dispatching network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:58:03 user nova-compute[73052]: WARNING nova.compute.manager [req-62c9c95b-d753-4075-90df-75ee9c2af6dd req-c8a73869-1b57-44ce-ab87-48e50a326ff8 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received unexpected event network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 for instance with vm_state building and task_state spawning.
Aug 26 14:58:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-09c98551-e243-4c52-a89d-e083daeea163 req-43e88edd-d826-4317-896a-90a7eadaf7d2 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received event network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-09c98551-e243-4c52-a89d-e083daeea163 req-43e88edd-d826-4317-896a-90a7eadaf7d2 service nova] Acquiring lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-09c98551-e243-4c52-a89d-e083daeea163 req-43e88edd-d826-4317-896a-90a7eadaf7d2 service nova] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-09c98551-e243-4c52-a89d-e083daeea163 req-43e88edd-d826-4317-896a-90a7eadaf7d2 service nova] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.017s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-09c98551-e243-4c52-a89d-e083daeea163 req-43e88edd-d826-4317-896a-90a7eadaf7d2 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] No waiting events found dispatching network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:58:05 user nova-compute[73052]: WARNING nova.compute.manager [req-09c98551-e243-4c52-a89d-e083daeea163 req-43e88edd-d826-4317-896a-90a7eadaf7d2 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received unexpected event network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 for instance with vm_state building and task_state spawning.
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061885.69452, 8331e32c-2e11-4bcd-8f31-669ff692688f => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:58:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] VM Resumed (Lifecycle Event)
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:58:05 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Instance spawned successfully.
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:58:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061885.6955523, 8331e32c-2e11-4bcd-8f31-669ff692688f => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:58:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] VM Started (Lifecycle Event)
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:58:05 user nova-compute[73052]: INFO nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061870.8122714, de3630fa-98b3-4a5a-b008-e98f0c72d0ea => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:58:05 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] VM Stopped (Lifecycle Event)
Aug 26 14:58:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:58:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b5b8d3c5-1894-4dbf-a8fe-903a6a43de34 None None] [instance: de3630fa-98b3-4a5a-b008-e98f0c72d0ea] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:58:05 user nova-compute[73052]: INFO nova.compute.manager [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Took 30.56 seconds to build instance.
Aug 26 14:58:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e8435fb-3c5f-4aa4-bb26-0a589a401562 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.662s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:58:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:58:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:58:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:58:07 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:58:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:58:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:58:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:58:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:09 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:14 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:58:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:17 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:58:17 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:58:17 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7620MB free_disk=25.190181732177734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:58:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:17 user nova-compute[73052]: INFO nova.compute.manager [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Detaching volume 80173a02-2f46-4208-8ac1-14747ee27b53
Aug 26 14:58:18 user nova-compute[73052]: INFO nova.virt.block_device [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Attempting to driver detach volume 80173a02-2f46-4208-8ac1-14747ee27b53 from mountpoint /dev/vdb
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Attempting to detach device vdb from instance d8fbdddb-dece-4881-bf03-96040e3c731d from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:58:18 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:58:18 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:58:18 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:58:18 user nova-compute[73052]:   <serial>80173a02-2f46-4208-8ac1-14747ee27b53</serial>
Aug 26 14:58:18 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 14:58:18 user nova-compute[73052]: </disk>
Aug 26 14:58:18 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:58:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully detached device vdb from instance d8fbdddb-dece-4881-bf03-96040e3c731d from the persistent domain config.
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8fbdddb-dece-4881-bf03-96040e3c731d from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:58:18 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:58:18 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:58:18 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:58:18 user nova-compute[73052]:   <serial>80173a02-2f46-4208-8ac1-14747ee27b53</serial>
Aug 26 14:58:18 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 14:58:18 user nova-compute[73052]: </disk>
Aug 26 14:58:18 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d8fbdddb-dece-4881-bf03-96040e3c731d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8331e32c-2e11-4bcd-8f31-669ff692688f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061898.5504882, d8fbdddb-dece-4881-bf03-96040e3c731d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8fbdddb-dece-4881-bf03-96040e3c731d {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:58:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully detached device vdb from instance d8fbdddb-dece-4881-bf03-96040e3c731d from the live domain config.
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZWXesYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:58:18 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4e7812-9f94-4910-a3e1-be3eab09eab7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[018a53c0-0d55-47a2-8cc5-ed192efb4b24]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:58:18 user nova-compute[73052]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:58:18 user nova-compute[73052]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:58:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 (non-flash)
Aug 26 14:58:18 user nova-compute[73052]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:58:18 user nova-compute[73052]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:58:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01e5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe75ce-37d2-4cd0-aaf6-d07573b7da13]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[318cb517-256c-46ef-aba4-7159b3d5d85d]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc8373c-c6eb-40b3-991a-2645fec59fd5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e9a0c3-774c-4203-bc72-1c6f69bbb014]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb39b21-6c4c-4e26-8172-64ec2bf2ab6d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb76fb76-1f16-4421-a368-fa3a850f9738]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260]
Aug 26 14:58:18 user nova-compute[73052]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53, portal: 172.16.0.220,3260] successful.
Aug 26 14:58:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80173a02-2f46-4208-8ac1-14747ee27b53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[74db19a2-e180-41a6-96cc-e8544f8eb203]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== disconnect_volume: return (303ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:58:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:58:19 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'flavor' on Instance uuid d8fbdddb-dece-4881-bf03-96040e3c731d {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:58:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e716327f-5ca9-44ef-8231-1f1c0a4f1f7c tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.888s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:58:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 14:58:38 user nova-compute[73052]: INFO nova.compute.claims [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Claim successful on node user
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 14:58:38 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.policy [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8677e9414700404ea8a9cf07cae299b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f05c842807aa4763b4e319c8098ba064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 14:58:38 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Creating image(s)
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.197s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.169s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk 1073741824" returned: 0 in 0.047s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Successfully created port: 3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Cannot resize image /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Ensure instance console log exists: /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Successfully updated port: 3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquired lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-f6957a32-142c-4fea-b3b9-f4bd6914a504 req-6fc238c9-53ab-4e4a-b64c-0ce7aac7a9a2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-changed-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-f6957a32-142c-4fea-b3b9-f4bd6914a504 req-6fc238c9-53ab-4e4a-b64c-0ce7aac7a9a2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Refreshing instance network info cache due to event network-changed-3a404e9c-e1ad-4c05-a706-f39084d8a5df. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f6957a32-142c-4fea-b3b9-f4bd6914a504 req-6fc238c9-53ab-4e4a-b64c-0ce7aac7a9a2 service nova] Acquiring lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updating instance_info_cache with network_info: [{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Releasing lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance network_info: |[{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f6957a32-142c-4fea-b3b9-f4bd6914a504 req-6fc238c9-53ab-4e4a-b64c-0ce7aac7a9a2 service nova] Acquired lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-f6957a32-142c-4fea-b3b9-f4bd6914a504 req-6fc238c9-53ab-4e4a-b64c-0ce7aac7a9a2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Refreshing network info cache for port 3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Start _get_guest_xml network_info=[{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 14:58:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:58:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] End _get_guest_xml xml=<domain type="kvm">
Aug 26 14:58:40 user nova-compute[73052]:   <uuid>9bdcc677-a1c4-4fc9-87b9-28a9babf53af</uuid>
Aug 26 14:58:40 user nova-compute[73052]:   <name>instance-00000025</name>
Aug 26 14:58:40 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 14:58:40 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 14:58:40 user nova-compute[73052]:   <metadata>
Aug 26 14:58:40 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 14:58:40 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 14:58:40 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeTestJSON-server-1311299839</nova:name>
Aug 26 14:58:40 user nova-compute[73052]:       <nova:creationTime>2023-08-26 14:58:40</nova:creationTime>
Aug 26 14:58:40 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 14:58:40 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 14:58:40 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 14:58:40 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 14:58:40 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 14:58:40 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 14:58:40 user nova-compute[73052]:       </nova:flavor>
Aug 26 14:58:40 user nova-compute[73052]:       <nova:owner>
Aug 26 14:58:40 user nova-compute[73052]:         <nova:user uuid="8677e9414700404ea8a9cf07cae299b2">tempest-AttachVolumeTestJSON-68461294-project-member</nova:user>
Aug 26 14:58:40 user nova-compute[73052]:         <nova:project uuid="f05c842807aa4763b4e319c8098ba064">tempest-AttachVolumeTestJSON-68461294</nova:project>
Aug 26 14:58:40 user nova-compute[73052]:       </nova:owner>
Aug 26 14:58:40 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 14:58:40 user nova-compute[73052]:       <nova:ports>
Aug 26 14:58:40 user nova-compute[73052]:         <nova:port uuid="3a404e9c-e1ad-4c05-a706-f39084d8a5df">
Aug 26 14:58:40 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 14:58:40 user nova-compute[73052]:         </nova:port>
Aug 26 14:58:40 user nova-compute[73052]:       </nova:ports>
Aug 26 14:58:40 user nova-compute[73052]:     </nova:instance>
Aug 26 14:58:40 user nova-compute[73052]:   </metadata>
Aug 26 14:58:40 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 14:58:40 user nova-compute[73052]:     <system>
Aug 26 14:58:40 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 14:58:40 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 14:58:40 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 14:58:40 user nova-compute[73052]:       <entry name="serial">9bdcc677-a1c4-4fc9-87b9-28a9babf53af</entry>
Aug 26 14:58:40 user nova-compute[73052]:       <entry name="uuid">9bdcc677-a1c4-4fc9-87b9-28a9babf53af</entry>
Aug 26 14:58:40 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 14:58:40 user nova-compute[73052]:     </system>
Aug 26 14:58:40 user nova-compute[73052]:   </sysinfo>
Aug 26 14:58:40 user nova-compute[73052]:   <os>
Aug 26 14:58:40 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 14:58:40 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 14:58:40 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 14:58:40 user nova-compute[73052]:   </os>
Aug 26 14:58:40 user nova-compute[73052]:   <features>
Aug 26 14:58:40 user nova-compute[73052]:     <acpi/>
Aug 26 14:58:40 user nova-compute[73052]:     <apic/>
Aug 26 14:58:40 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 14:58:40 user nova-compute[73052]:   </features>
Aug 26 14:58:40 user nova-compute[73052]:   <clock offset="utc">
Aug 26 14:58:40 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 14:58:40 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 14:58:40 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 14:58:40 user nova-compute[73052]:   </clock>
Aug 26 14:58:40 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 14:58:40 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 14:58:40 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 14:58:40 user nova-compute[73052]:   </cpu>
Aug 26 14:58:40 user nova-compute[73052]:   <devices>
Aug 26 14:58:40 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 14:58:40 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 14:58:40 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk"/>
Aug 26 14:58:40 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 14:58:40 user nova-compute[73052]:     </disk>
Aug 26 14:58:40 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 14:58:40 user nova-compute[73052]:       <mac address="fa:16:3e:e8:36:41"/>
Aug 26 14:58:40 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:58:40 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 14:58:40 user nova-compute[73052]:       <target dev="tap3a404e9c-e1"/>
Aug 26 14:58:40 user nova-compute[73052]:     </interface>
Aug 26 14:58:40 user nova-compute[73052]:     <serial type="pty">
Aug 26 14:58:40 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/console.log" append="off"/>
Aug 26 14:58:40 user nova-compute[73052]:     </serial>
Aug 26 14:58:40 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 14:58:40 user nova-compute[73052]:     <video>
Aug 26 14:58:40 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 14:58:40 user nova-compute[73052]:     </video>
Aug 26 14:58:40 user nova-compute[73052]:     <rng model="virtio">
Aug 26 14:58:40 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 14:58:40 user nova-compute[73052]:     </rng>
Aug 26 14:58:40 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 14:58:40 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 14:58:40 user nova-compute[73052]:       <stats period="10"/>
Aug 26 14:58:40 user nova-compute[73052]:     </memballoon>
Aug 26 14:58:40 user nova-compute[73052]:   </devices>
Aug 26 14:58:40 user nova-compute[73052]: </domain>
Aug 26 14:58:40 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T14:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG os_vif [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a404e9c-e1, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a404e9c-e1, col_values=(('external_ids', {'iface-id': '3a404e9c-e1ad-4c05-a706-f39084d8a5df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:36:41', 'vm-uuid': '9bdcc677-a1c4-4fc9-87b9-28a9babf53af'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:40 user nova-compute[73052]: INFO os_vif [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1')
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:58:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No VIF found with MAC fa:16:3e:e8:36:41, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:58:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-f6957a32-142c-4fea-b3b9-f4bd6914a504 req-6fc238c9-53ab-4e4a-b64c-0ce7aac7a9a2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updated VIF entry in instance network info cache for port 3a404e9c-e1ad-4c05-a706-f39084d8a5df. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:58:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-f6957a32-142c-4fea-b3b9-f4bd6914a504 req-6fc238c9-53ab-4e4a-b64c-0ce7aac7a9a2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updating instance_info_cache with network_info: [{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:58:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f6957a32-142c-4fea-b3b9-f4bd6914a504 req-6fc238c9-53ab-4e4a-b64c-0ce7aac7a9a2 service nova] Releasing lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-65f98b75-704e-4aa1-9eaa-9903b7eada26 req-9c25a206-4f95-483e-84d4-055168b8a745 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received event network-changed-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-65f98b75-704e-4aa1-9eaa-9903b7eada26 req-9c25a206-4f95-483e-84d4-055168b8a745 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Refreshing instance network info cache due to event network-changed-2143778c-ddba-49d1-94fe-ae0a4eb13540. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-65f98b75-704e-4aa1-9eaa-9903b7eada26 req-9c25a206-4f95-483e-84d4-055168b8a745 service nova] Acquiring lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-65f98b75-704e-4aa1-9eaa-9903b7eada26 req-9c25a206-4f95-483e-84d4-055168b8a745 service nova] Acquired lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-65f98b75-704e-4aa1-9eaa-9903b7eada26 req-9c25a206-4f95-483e-84d4-055168b8a745 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Refreshing network info cache for port 2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-4f501b29-f6b1-4716-bc06-e6eca94b30c5 req-9136b5cb-72d7-4117-a859-b5b073b29ee6 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4f501b29-f6b1-4716-bc06-e6eca94b30c5 req-9136b5cb-72d7-4117-a859-b5b073b29ee6 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4f501b29-f6b1-4716-bc06-e6eca94b30c5 req-9136b5cb-72d7-4117-a859-b5b073b29ee6 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4f501b29-f6b1-4716-bc06-e6eca94b30c5 req-9136b5cb-72d7-4117-a859-b5b073b29ee6 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-4f501b29-f6b1-4716-bc06-e6eca94b30c5 req-9136b5cb-72d7-4117-a859-b5b073b29ee6 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:58:42 user nova-compute[73052]: WARNING nova.compute.manager [req-4f501b29-f6b1-4716-bc06-e6eca94b30c5 req-9136b5cb-72d7-4117-a859-b5b073b29ee6 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state building and task_state spawning.
Aug 26 14:58:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lazy-loading 'flavor' on Instance uuid 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-65f98b75-704e-4aa1-9eaa-9903b7eada26 req-9c25a206-4f95-483e-84d4-055168b8a745 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updated VIF entry in instance network info cache for port 2143778c-ddba-49d1-94fe-ae0a4eb13540. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-65f98b75-704e-4aa1-9eaa-9903b7eada26 req-9c25a206-4f95-483e-84d4-055168b8a745 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updating instance_info_cache with network_info: [{"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-65f98b75-704e-4aa1-9eaa-9903b7eada26 req-9c25a206-4f95-483e-84d4-055168b8a745 service nova] Releasing lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:43 user nova-compute[73052]: INFO nova.compute.manager [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Attaching volume 1f672247-4025-40d0-b410-f100dfe0996d to /dev/vdb
Aug 26 14:58:43 user nova-compute[73052]: DEBUG os_brick.utils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed8ac0c-9058-440e-bb39-dc01e54d2fb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8575b9c2-036a-406a-a8e9-7049f0d2a573]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.052s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e5186c-ae4c-4937-b828-5e5eaf786a8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b6a9e7-9c16-4aaa-89d9-9b9f67675a62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:58:43 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:58:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ea7498-f88e-48b3-b965-c028b1b979d1]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG os_brick.utils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:58:43 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updating existing volume attachment record: 3689ff59-726f-4b0c-8fae-cc6ac41e48ba {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061924.5033739, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:58:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Resumed (Lifecycle Event)
Aug 26 14:58:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance spawned successfully.
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 14:58:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693061924.5038881, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:58:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Started (Lifecycle Event)
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 14:58:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 14:58:44 user nova-compute[73052]: INFO nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:58:44 user nova-compute[73052]: INFO nova.compute.manager [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Took 6.50 seconds to build instance.
Aug 26 14:58:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c43eafcf-c395-4888-964d-5691c258cf8e tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.602s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-01f039dd-e11a-44e5-a913-1ac7496b0df9 req-635ca3a7-8fbe-4356-b303-96de5929bb72 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-01f039dd-e11a-44e5-a913-1ac7496b0df9 req-635ca3a7-8fbe-4356-b303-96de5929bb72 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-01f039dd-e11a-44e5-a913-1ac7496b0df9 req-635ca3a7-8fbe-4356-b303-96de5929bb72 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-01f039dd-e11a-44e5-a913-1ac7496b0df9 req-635ca3a7-8fbe-4356-b303-96de5929bb72 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-01f039dd-e11a-44e5-a913-1ac7496b0df9 req-635ca3a7-8fbe-4356-b303-96de5929bb72 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:58:44 user nova-compute[73052]: WARNING nova.compute.manager [req-01f039dd-e11a-44e5-a913-1ac7496b0df9 req-635ca3a7-8fbe-4356-b303-96de5929bb72 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state active and task_state None.
Aug 26 14:58:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:46 user nova-compute[73052]: INFO nova.compute.manager [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Detaching volume 4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0
Aug 26 14:58:46 user nova-compute[73052]: INFO nova.virt.block_device [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Attempting to driver detach volume 4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 from mountpoint /dev/vdb
Aug 26 14:58:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Attempting to detach device vdb from instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:58:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:58:46 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:58:46 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:58:46 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:58:46 user nova-compute[73052]:   <serial>4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0</serial>
Aug 26 14:58:46 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:58:46 user nova-compute[73052]: </disk>
Aug 26 14:58:46 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:58:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Successfully detached device vdb from instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2 from the persistent domain config.
Aug 26 14:58:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:58:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:58:46 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:58:46 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:58:46 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:58:46 user nova-compute[73052]:   <serial>4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0</serial>
Aug 26 14:58:46 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:58:46 user nova-compute[73052]: </disk>
Aug 26 14:58:46 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:58:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:58:46 user nova-compute[73052]: INFO nova.compute.manager [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] instance snapshotting
Aug 26 14:58:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Beginning live snapshot process
Aug 26 14:58:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061927.1494975, dfec8dbe-de2a-4166-b4a8-4079d7b480c2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:58:47 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Successfully detached device vdb from instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2 from the live domain config.
Aug 26 14:58:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJTXjECr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:58:47 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json -f qcow2 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3bf468-ca7a-4559-8fab-0df93c3e9d9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3141d7-d71f-4755-932a-4a9423741d22]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:58:47 user nova-compute[73052]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:58:47 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 (non-flash)
Aug 26 14:58:47 user nova-compute[73052]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:58:47 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacfc379-2b62-49dd-83c1-e8652852cb7f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c1c09c-27f7-4364-ae0e-bb84e540dec1]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.036s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa3a43-6489-4c15-b187-16139675256f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json -f qcow2 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f3a5bf-dd8d-4133-8da7-320f1b2e3415]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef905e-e6bb-46fc-9f34-aaf85a44c6f2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[748e360d-c791-4022-96be-b15fe41d4248]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0, portal: 172.16.0.220,3260]
Aug 26 14:58:47 user nova-compute[73052]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0, portal: 172.16.0.220,3260] successful.
Aug 26 14:58:47 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e5bdf8-8227-4b0a-86f4-4e66bc8f8aba]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] <== disconnect_volume: return (385ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.266s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxijvyt_1/635f05fa0653421fa3fcda2a8b99e505.delta 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxijvyt_1/635f05fa0653421fa3fcda2a8b99e505.delta 1073741824" returned: 0 in 0.056s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:47 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 14:58:48 user nova-compute[73052]: DEBUG nova.objects.instance [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'flavor' on Instance uuid dfec8dbe-de2a-4166-b4a8-4079d7b480c2 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40bad5bc-694c-4b31-b900-8f9134dfadf9 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.135s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.992s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:48 user nova-compute[73052]: INFO nova.compute.manager [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Terminating instance
Aug 26 14:58:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 14:58:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-a7ad52ec-8659-466e-aec6-fed991a16f10 req-0a41f90a-d717-4a00-a5ac-71318335c85c service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received event network-vif-unplugged-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a7ad52ec-8659-466e-aec6-fed991a16f10 req-0a41f90a-d717-4a00-a5ac-71318335c85c service nova] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a7ad52ec-8659-466e-aec6-fed991a16f10 req-0a41f90a-d717-4a00-a5ac-71318335c85c service nova] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a7ad52ec-8659-466e-aec6-fed991a16f10 req-0a41f90a-d717-4a00-a5ac-71318335c85c service nova] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-a7ad52ec-8659-466e-aec6-fed991a16f10 req-0a41f90a-d717-4a00-a5ac-71318335c85c service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] No waiting events found dispatching network-vif-unplugged-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-a7ad52ec-8659-466e-aec6-fed991a16f10 req-0a41f90a-d717-4a00-a5ac-71318335c85c service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received event network-vif-unplugged-71ce5d69-db9a-4e03-b4de-481296af5e31 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:58:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Instance destroyed successfully.
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'resources' on Instance uuid dfec8dbe-de2a-4166-b4a8-4079d7b480c2 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxijvyt_1/635f05fa0653421fa3fcda2a8b99e505.delta /opt/stack/data/nova/instances/snapshots/tmpxijvyt_1/635f05fa0653421fa3fcda2a8b99e505 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-932259498',display_name='tempest-VolumesSnapshotTestJSON-instance-932259498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-932259498',id=32,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr01L6rcTzRN6tg9NEh4Dkdr9FgY/HU1daoj6IooVqQZzx0rLxZHn4s6JrTHo7S+M4PSI1/MflpyY1YppSyrBb9nwMamq2KNZAyYLBRlJeuVCqg8r4xOZgVkgMG4DR0Hw==',key_name='tempest-keypair-1269749487',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:55:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec12a3cd3b3b4b13a00609468911ab32',ramdisk_id='',reservation_id='r-bvkhdi6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2099506189',owner_user_name='tempest-VolumesSnapshotTestJSON-2099506189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182f8d861f1d422aaa2ac5fbd8442f7f',uuid=dfec8dbe-de2a-4166-b4a8-4079d7b480c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converting VIF {"id": "71ce5d69-db9a-4e03-b4de-481296af5e31", "address": "fa:16:3e:18:1f:1f", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ce5d69-db", "ovs_interfaceid": "71ce5d69-db9a-4e03-b4de-481296af5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:1f:1f,bridge_name='br-int',has_traffic_filtering=True,id=71ce5d69-db9a-4e03-b4de-481296af5e31,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ce5d69-db') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_vif [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:1f:1f,bridge_name='br-int',has_traffic_filtering=True,id=71ce5d69-db9a-4e03-b4de-481296af5e31,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ce5d69-db') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71ce5d69-db, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:49 user nova-compute[73052]: INFO os_vif [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:1f:1f,bridge_name='br-int',has_traffic_filtering=True,id=71ce5d69-db9a-4e03-b4de-481296af5e31,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ce5d69-db')
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJTXjECr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:58:49 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b337ca5-d5ec-4c36-bbb6-8de5b629e0b0', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f405d3a-c3b7-4118-8ec5-d9308e6f551f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d7152-d737-46dd-8aa3-783782c695e9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:58:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:58:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0559120>, {}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Disconnecting from: [] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] <== disconnect_volume: return (58ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:58:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Deleting instance files /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2_del
Aug 26 14:58:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Deletion of /opt/stack/data/nova/instances/dfec8dbe-de2a-4166-b4a8-4079d7b480c2_del complete
Aug 26 14:58:49 user nova-compute[73052]: INFO nova.compute.manager [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:58:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxijvyt_1/635f05fa0653421fa3fcda2a8b99e505.delta /opt/stack/data/nova/instances/snapshots/tmpxijvyt_1/635f05fa0653421fa3fcda2a8b99e505" returned: 0 in 0.279s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:58:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Snapshot extracted, beginning image upload
Aug 26 14:58:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:50 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:58:50 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Took 1.06 seconds to deallocate network for instance.
Aug 26 14:58:50 user nova-compute[73052]: WARNING nova.volume.cinder [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Attachment 75e59bd3-aff3-4ab8-87bd-3d51b5dc2ee2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 75e59bd3-aff3-4ab8-87bd-3d51b5dc2ee2. (HTTP 404) (Request-ID: req-acf3d89c-f19a-4098-ae22-fd8b2f8a09a5)
Aug 26 14:58:50 user nova-compute[73052]: INFO nova.compute.manager [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 14:58:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-98a01ef8-3334-478e-ab36-0ece2f0b13c9 req-3b3ba9b7-63b8-4d4e-8624-bee17ee87c9d service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received event network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-98a01ef8-3334-478e-ab36-0ece2f0b13c9 req-3b3ba9b7-63b8-4d4e-8624-bee17ee87c9d service nova] Acquiring lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-98a01ef8-3334-478e-ab36-0ece2f0b13c9 req-3b3ba9b7-63b8-4d4e-8624-bee17ee87c9d service nova] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-98a01ef8-3334-478e-ab36-0ece2f0b13c9 req-3b3ba9b7-63b8-4d4e-8624-bee17ee87c9d service nova] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-98a01ef8-3334-478e-ab36-0ece2f0b13c9 req-3b3ba9b7-63b8-4d4e-8624-bee17ee87c9d service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] No waiting events found dispatching network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:58:51 user nova-compute[73052]: WARNING nova.compute.manager [req-98a01ef8-3334-478e-ab36-0ece2f0b13c9 req-3b3ba9b7-63b8-4d4e-8624-bee17ee87c9d service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received unexpected event network-vif-plugged-71ce5d69-db9a-4e03-b4de-481296af5e31 for instance with vm_state deleted and task_state None.
Aug 26 14:58:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-98a01ef8-3334-478e-ab36-0ece2f0b13c9 req-3b3ba9b7-63b8-4d4e-8624-bee17ee87c9d service nova] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Received event network-vif-deleted-71ce5d69-db9a-4e03-b4de-481296af5e31 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:58:51 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Deleted allocations for instance dfec8dbe-de2a-4166-b4a8-4079d7b480c2
Aug 26 14:58:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b54f0758-c5e0-42ce-bff2-1ccd32460c37 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "dfec8dbe-de2a-4166-b4a8-4079d7b480c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.170s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:58:53 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Snapshot image upload complete
Aug 26 14:58:53 user nova-compute[73052]: INFO nova.compute.manager [None req-4e2a0bb4-3155-4b00-8f6d-31dc090a0075 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Took 6.15 seconds to snapshot the instance on the hypervisor.
Aug 26 14:58:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:58:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:59:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:59:04 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061929.570859, dfec8dbe-de2a-4166-b4a8-4079d7b480c2 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:59:04 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] VM Stopped (Lifecycle Event)
Aug 26 14:59:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e631e1a3-6ded-4c90-a1b0-3500c83fac94 None None] [instance: dfec8dbe-de2a-4166-b4a8-4079d7b480c2] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:59:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rcHasvKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:59:06 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:06 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:06 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f945d33-ef53-4643-8c15-a5cc92decc12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:59:06 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[58155c8f-610a-4cfa-8298-f56f0da4cb30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d] added
Aug 26 14:59:06 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7527795-b91e-4098-bb1b-d36531347c65]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4f334a-cda1-47d5-bd3b-8a4b8e233ac8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rcHasvKF {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rcHasvKF" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f9d5e5-e9b9-451f-8bca-1c80b12c0a9b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rcHasvKF'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[310a1c08-32bd-41ce-8d9a-ef81305468fb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce654a9-30a9-4ebc-80fa-5a014b5d0986]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:06 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:06 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[22be82ba-8f9f-463b-a3a0-9c55da32cc51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d, portal: 172.16.0.220,3260]
Aug 26 14:59:06 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d, portal: 172.16.0.220,3260] successful.
Aug 26 14:59:06 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1363007-5c63-4f0a-91c8-b72b71b49738]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a0227b-dd3a-4e9b-9a30-c3a77ccab21d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:06 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:06 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:06 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:06 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[641e9869-179e-4d4b-a394-bc8c388506c2]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:59:06 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updating instance_info_cache with network_info: [{"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-d8fbdddb-dece-4881-bf03-96040e3c731d" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rcHasvKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26165653736346535', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165653736346535', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lazy-loading 'flavor' on Instance uuid 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:59:07 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:59:07 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 14:59:07 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:59:07 user nova-compute[73052]:   <serial>1f672247-4025-40d0-b410-f100dfe0996d</serial>
Aug 26 14:59:07 user nova-compute[73052]: </disk>
Aug 26 14:59:07 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No VIF found with MAC fa:16:3e:e5:8e:10, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:08 user nova-compute[73052]: INFO nova.compute.manager [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Terminating instance
Aug 26 14:59:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d0455729-b843-4bbe-9744-afe62b7b05cc tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.052s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-5a395534-3a32-47f9-a8d6-96e13a532982 req-e2b3b00a-21ff-4cb0-8c47-959b8b1541bc service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-unplugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5a395534-3a32-47f9-a8d6-96e13a532982 req-e2b3b00a-21ff-4cb0-8c47-959b8b1541bc service nova] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5a395534-3a32-47f9-a8d6-96e13a532982 req-e2b3b00a-21ff-4cb0-8c47-959b8b1541bc service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5a395534-3a32-47f9-a8d6-96e13a532982 req-e2b3b00a-21ff-4cb0-8c47-959b8b1541bc service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-5a395534-3a32-47f9-a8d6-96e13a532982 req-e2b3b00a-21ff-4cb0-8c47-959b8b1541bc service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] No waiting events found dispatching network-vif-unplugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:59:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-5a395534-3a32-47f9-a8d6-96e13a532982 req-e2b3b00a-21ff-4cb0-8c47-959b8b1541bc service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-unplugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Instance destroyed successfully.
Aug 26 14:59:09 user nova-compute[73052]: DEBUG nova.objects.instance [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'resources' on Instance uuid d8fbdddb-dece-4881-bf03-96040e3c731d {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2040530059',display_name='tempest-ServerActionsTestOtherA-server-990279462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2040530059',id=29,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfhquXrIGjGxXYztmgLJzSQQlgnewhkKqp9DxFH0DM8MZ8W5nr5mod0b8V90UIh1B93o92HL2vTz+YFWuNMdp4aBB1FnzjU9k3D0nnFG2lp2L3jpmRp0uRikTpZhcgD7w==',key_name='tempest-keypair-1035979049',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-0biclnlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:55:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=d8fbdddb-dece-4881-bf03-96040e3c731d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "address": "fa:16:3e:22:ab:2e", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap770c3e91-7e", "ovs_interfaceid": "770c3e91-7e2f-4dc9-9b6f-395dc26faf87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG os_vif [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap770c3e91-7e, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:59:09 user nova-compute[73052]: INFO os_vif [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ab:2e,bridge_name='br-int',has_traffic_filtering=True,id=770c3e91-7e2f-4dc9-9b6f-395dc26faf87,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap770c3e91-7e')
Aug 26 14:59:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Deleting instance files /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d_del
Aug 26 14:59:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Deletion of /opt/stack/data/nova/instances/d8fbdddb-dece-4881-bf03-96040e3c731d_del complete
Aug 26 14:59:09 user nova-compute[73052]: INFO nova.compute.manager [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 14:59:09 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:09 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:59:10 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Took 0.84 seconds to deallocate network for instance.
Aug 26 14:59:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:10 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Deleted allocations for instance d8fbdddb-dece-4881-bf03-96040e3c731d
Aug 26 14:59:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-de8cf55d-bda1-45bc-89c8-ffee33ab20b7 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.166s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e37d6dd-1630-4405-a5e8-8e62378bc445 req-54c4eb02-0db2-43de-a87e-6f546d878786 service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e37d6dd-1630-4405-a5e8-8e62378bc445 req-54c4eb02-0db2-43de-a87e-6f546d878786 service nova] Acquiring lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e37d6dd-1630-4405-a5e8-8e62378bc445 req-54c4eb02-0db2-43de-a87e-6f546d878786 service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e37d6dd-1630-4405-a5e8-8e62378bc445 req-54c4eb02-0db2-43de-a87e-6f546d878786 service nova] Lock "d8fbdddb-dece-4881-bf03-96040e3c731d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e37d6dd-1630-4405-a5e8-8e62378bc445 req-54c4eb02-0db2-43de-a87e-6f546d878786 service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] No waiting events found dispatching network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:59:10 user nova-compute[73052]: WARNING nova.compute.manager [req-1e37d6dd-1630-4405-a5e8-8e62378bc445 req-54c4eb02-0db2-43de-a87e-6f546d878786 service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received unexpected event network-vif-plugged-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 for instance with vm_state deleted and task_state None.
Aug 26 14:59:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e37d6dd-1630-4405-a5e8-8e62378bc445 req-54c4eb02-0db2-43de-a87e-6f546d878786 service nova] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Received event network-vif-deleted-770c3e91-7e2f-4dc9-9b6f-395dc26faf87 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-a21afbc5-fc24-4dfd-9209-1532f73c1ac3 req-c9eac96d-4957-4de7-b791-06cb74ec5343 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-changed-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-a21afbc5-fc24-4dfd-9209-1532f73c1ac3 req-c9eac96d-4957-4de7-b791-06cb74ec5343 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Refreshing instance network info cache due to event network-changed-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a21afbc5-fc24-4dfd-9209-1532f73c1ac3 req-c9eac96d-4957-4de7-b791-06cb74ec5343 service nova] Acquiring lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a21afbc5-fc24-4dfd-9209-1532f73c1ac3 req-c9eac96d-4957-4de7-b791-06cb74ec5343 service nova] Acquired lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG nova.network.neutron [req-a21afbc5-fc24-4dfd-9209-1532f73c1ac3 req-c9eac96d-4957-4de7-b791-06cb74ec5343 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Refreshing network info cache for port 7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG nova.objects.instance [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lazy-loading 'flavor' on Instance uuid 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'flavor' on Instance uuid de1ab010-f0e3-48c7-bc42-b2bb5746cc13 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG nova.network.neutron [req-a21afbc5-fc24-4dfd-9209-1532f73c1ac3 req-c9eac96d-4957-4de7-b791-06cb74ec5343 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updated VIF entry in instance network info cache for port 7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG nova.network.neutron [req-a21afbc5-fc24-4dfd-9209-1532f73c1ac3 req-c9eac96d-4957-4de7-b791-06cb74ec5343 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updating instance_info_cache with network_info: [{"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:11 user nova-compute[73052]: INFO nova.compute.manager [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Attaching volume a63e38ed-fa38-46a3-9009-6787e51d3197 to /dev/vdb
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:11 user nova-compute[73052]: INFO nova.compute.manager [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Attaching volume 4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 to /dev/vdc
Aug 26 14:59:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a21afbc5-fc24-4dfd-9209-1532f73c1ac3 req-c9eac96d-4957-4de7-b791-06cb74ec5343 service nova] Releasing lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.utils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.utils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4000f1c7-17c2-46a8-ac77-fde9434e11cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa153dfb-8f87-4f09-86ae-9721ed6a3472]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c1e02-87de-4216-b84f-86c3d44bb6d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[610fa569-8603-442b-9183-213ba20db27a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a83328-50fc-4517-b49a-f00fa346b2aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[671666a5-c887-4f3e-af33-7a1fd000e5da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdd98ce-fdc0-44ed-bae9-0739a58744e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e028a6b-f913-46f6-870e-7eea6ab1d3bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:59:12 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4603bbda-4a3a-4e07-91e6-ee37d23d5497]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.utils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updating existing volume attachment record: d70a3322-985c-4a8f-bdc8-d42d7b73a5b4 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:59:12 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:59:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5f5be5-9024-4beb-8882-7915b22fe2ea]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG os_brick.utils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:59:12 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updating existing volume attachment record: 2f6821f6-668f-4168-9db2-77201a0052e5 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:59:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:59:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:15 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:59:15 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:18 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:59:18 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7842MB free_disk=25.2034912109375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8331e32c-2e11-4bcd-8f31-669ff692688f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:59:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPXyMECz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:59:23 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:23 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:23 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b80eebe-603d-4942-9db7-92c5a5b00e5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:59:23 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[deccdb15-d572-4659-bf36-151cae8c99f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197] added
Aug 26 14:59:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9b29cd-4cea-4e38-8ce1-9f9c5c4013f5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bfd710-315c-4938-8089-11da09462c62]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPXyMECz {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPXyMECz" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f143672e-e572-4bee-87cd-c71327da72d0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPXyMECz'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d717a6-5991-4d8f-ba6a-84d23bd964a2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc62878-ec5e-45ca-93fb-59f4c377feb5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:23 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:23 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a0718-ee06-4d23-a746-d04684f06ebb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197, portal: 172.16.0.220,3260]
Aug 26 14:59:23 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197, portal: 172.16.0.220,3260] successful.
Aug 26 14:59:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a3538-ed33-4008-9deb-8e501fd0674d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a63fb6-e981-4532-abc0-dbd813c42a1a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:23 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:23 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:23 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:23 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISDVjTZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:59:23 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece00c6a-6a35-4a11-a56a-931091cf1011]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:59:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPXyMECz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061949.1059668, d8fbdddb-dece-4881-bf03-96040e3c731d => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:59:24 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] VM Stopped (Lifecycle Event)
Aug 26 14:59:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2024c429-1161-4062-9f8e-185a383479a0 None None] [instance: d8fbdddb-dece-4881-bf03-96040e3c731d] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23033393237653465', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033393237653465', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.016s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:24 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:24 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'flavor' on Instance uuid de1ab010-f0e3-48c7-bc42-b2bb5746cc13 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92daa50-3002-42e9-960e-8f2d2e81346d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:59:24 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:59:24 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:59:24 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:59:24 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:59:24 user nova-compute[73052]:   <serial>a63e38ed-fa38-46a3-9009-6787e51d3197</serial>
Aug 26 14:59:24 user nova-compute[73052]: </disk>
Aug 26 14:59:24 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c847f2f4-84b8-440a-9bd9-3f1e2829b254]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5] added
Aug 26 14:59:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc1a17e-7afd-43f5-ade0-540a137fb6cd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a1b18-c4b3-48b4-a57b-50f0e652b995]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISDVjTZx {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISDVjTZx" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ab86cf-8a2b-48f3-9aaf-864a9ebb227f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ISDVjTZx'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd98d508-d758-4352-b9fd-430741d9435b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a5af02-663b-410b-bce7-46ff4f3949c6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba41c852-04cf-4461-bbc9-7f28b2acd869]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5, portal: 172.16.0.220,3260]
Aug 26 14:59:24 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5, portal: 172.16.0.220,3260] successful.
Aug 26 14:59:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf7136a-9db7-4ee1-9e2e-529f0e1d94c5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd88c298-3de2-488b-a236-d242c095f7b3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 (non-flash)
Aug 26 14:59:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:59:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f951537b-a84c-4588-acdd-6a391a5f7f2e]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:59:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISDVjTZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:59:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:59:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:59:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No VIF found with MAC fa:16:3e:eb:30:59, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:59:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a4c4e52e-5086-4733-a65b-87c7acbbc835 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.308s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] <== connect_volume: return (2467ms) {'type': 'block', 'scsi_wwn': '23334353161633462', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334353161633462', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG nova.objects.instance [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lazy-loading 'flavor' on Instance uuid 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:59:26 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:59:26 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:59:26 user nova-compute[73052]:   <target dev="vdc" bus="virtio"/>
Aug 26 14:59:26 user nova-compute[73052]:   <serial>4ed0537f-a4d3-4db9-b740-8c1eb978c4a5</serial>
Aug 26 14:59:26 user nova-compute[73052]: </disk>
Aug 26 14:59:26 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] No VIF found with MAC fa:16:3e:e5:8e:10, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:59:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-44d5e567-b868-484c-aa26-a84651981770 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.860s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.007s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:27 user nova-compute[73052]: INFO nova.compute.manager [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Detaching volume 4ed0537f-a4d3-4db9-b740-8c1eb978c4a5
Aug 26 14:59:27 user nova-compute[73052]: INFO nova.virt.block_device [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Attempting to driver detach volume 4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 from mountpoint /dev/vdc
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Attempting to detach device vdc from instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:59:27 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:59:27 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:59:27 user nova-compute[73052]:   <target dev="vdc" bus="virtio"/>
Aug 26 14:59:27 user nova-compute[73052]:   <serial>4ed0537f-a4d3-4db9-b740-8c1eb978c4a5</serial>
Aug 26 14:59:27 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 14:59:27 user nova-compute[73052]: </disk>
Aug 26 14:59:27 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:59:27 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Successfully detached device vdc from instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 from the persistent domain config.
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:59:27 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:59:27 user nova-compute[73052]:   <source dev="/dev/sdd"/>
Aug 26 14:59:27 user nova-compute[73052]:   <target dev="vdc" bus="virtio"/>
Aug 26 14:59:27 user nova-compute[73052]:   <serial>4ed0537f-a4d3-4db9-b740-8c1eb978c4a5</serial>
Aug 26 14:59:27 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 14:59:27 user nova-compute[73052]: </disk>
Aug 26 14:59:27 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.015s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:27 user nova-compute[73052]: INFO nova.compute.manager [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Detaching volume a63e38ed-fa38-46a3-9009-6787e51d3197
Aug 26 14:59:27 user nova-compute[73052]: INFO nova.virt.block_device [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Attempting to driver detach volume a63e38ed-fa38-46a3-9009-6787e51d3197 from mountpoint /dev/vdb
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061967.9639666, 4a45b34c-d927-4a7e-b71a-fa665269cdc0 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:59:27 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Successfully detached device vdc from instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 from the live domain config.
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISDVjTZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:59:27 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Attempting to detach device vdb from instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:59:27 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:59:27 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:59:27 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:59:27 user nova-compute[73052]:   <serial>a63e38ed-fa38-46a3-9009-6787e51d3197</serial>
Aug 26 14:59:27 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:59:27 user nova-compute[73052]: </disk>
Aug 26 14:59:27 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:59:27 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Successfully detached device vdb from instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 from the persistent domain config.
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:59:27 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:59:27 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 14:59:27 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:59:27 user nova-compute[73052]:   <serial>a63e38ed-fa38-46a3-9009-6787e51d3197</serial>
Aug 26 14:59:27 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:59:27 user nova-compute[73052]: </disk>
Aug 26 14:59:27 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c3b220-4491-454c-a6eb-0df7f1d254ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca7bf91-783e-4c21-a301-17b6eaac62f0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01f1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b4c6bc-45c3-4fd0-a3a2-727489d14532]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd14270-e30a-4ac5-a074-d7b95b7d4172]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d1072d-3ae6-4bce-abe8-25be6322e123]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[723dbdde-1f5b-4464-a338-eccef7b2c4b7]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8927a2-dc4c-4b33-9b85-35a2c41cd6c3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7dfa7ab-b8fc-474d-92fc-1829d34eb6b7 req-6cc6ffaf-f2e4-44cc-a525-3bf18fcb2780 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received event network-changed-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-c7dfa7ab-b8fc-474d-92fc-1829d34eb6b7 req-6cc6ffaf-f2e4-44cc-a525-3bf18fcb2780 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Refreshing instance network info cache due to event network-changed-b27b4556-b692-4099-88f9-7519d6c2a6d8. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7dfa7ab-b8fc-474d-92fc-1829d34eb6b7 req-6cc6ffaf-f2e4-44cc-a525-3bf18fcb2780 service nova] Acquiring lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7dfa7ab-b8fc-474d-92fc-1829d34eb6b7 req-6cc6ffaf-f2e4-44cc-a525-3bf18fcb2780 service nova] Acquired lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-c7dfa7ab-b8fc-474d-92fc-1829d34eb6b7 req-6cc6ffaf-f2e4-44cc-a525-3bf18fcb2780 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Refreshing network info cache for port b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e9c0c-a05e-496e-aa80-f0dea60930cc]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5, portal: 172.16.0.220,3260]
Aug 26 14:59:28 user nova-compute[73052]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5, portal: 172.16.0.220,3260] successful.
Aug 26 14:59:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed0537f-a4d3-4db9-b740-8c1eb978c4a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa5675-9794-4ffc-9eb1-4e478901de92]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] <== disconnect_volume: return (304ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693061968.443197, de1ab010-f0e3-48c7-bc42-b2bb5746cc13 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:59:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Successfully detached device vdb from instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 from the live domain config.
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPXyMECz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:59:28 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a65fa2-11cb-47e2-82f1-418475db6693]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f3cdb-5085-470a-9a4d-4a14cc7a2782]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:28 user nova-compute[73052]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 (non-flash)
Aug 26 14:59:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a99b5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[97298ac5-2b9c-4e5a-99fb-91764cbb39f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[584b9903-5c21-45a2-8204-aaed91abfd53]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82717c0-c1a4-44b7-a7f6-101496c15f1f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884ec20-9e53-4f5e-9b58-4ea501259009]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae629529-b5f1-4cc4-9d8a-e4f74e12808a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-c7dfa7ab-b8fc-474d-92fc-1829d34eb6b7 req-6cc6ffaf-f2e4-44cc-a525-3bf18fcb2780 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Updated VIF entry in instance network info cache for port b27b4556-b692-4099-88f9-7519d6c2a6d8. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-c7dfa7ab-b8fc-474d-92fc-1829d34eb6b7 req-6cc6ffaf-f2e4-44cc-a525-3bf18fcb2780 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Updating instance_info_cache with network_info: [{"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c7dfa7ab-b8fc-474d-92fc-1829d34eb6b7 req-6cc6ffaf-f2e4-44cc-a525-3bf18fcb2780 service nova] Releasing lock "refresh_cache-8331e32c-2e11-4bcd-8f31-669ff692688f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbccca5b-7e55-45bb-a4d6-c6d20113d8dd]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197, portal: 172.16.0.220,3260]
Aug 26 14:59:28 user nova-compute[73052]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197, portal: 172.16.0.220,3260] successful.
Aug 26 14:59:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63e38ed-fa38-46a3-9009-6787e51d3197 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b4dd16-c4a0-4cae-8ea9-be69b25bbcea]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] <== disconnect_volume: return (298ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:59:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "8331e32c-2e11-4bcd-8f31-669ff692688f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:29 user nova-compute[73052]: INFO nova.compute.manager [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Terminating instance
Aug 26 14:59:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lazy-loading 'flavor' on Instance uuid 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e37e78fe-88af-4a37-9318-92698475db51 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.972s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'flavor' on Instance uuid de1ab010-f0e3-48c7-bc42-b2bb5746cc13 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1ecb24e7-7726-466b-83df-9c687acef656 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.695s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Instance destroyed successfully.
Aug 26 14:59:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'resources' on Instance uuid 8331e32c-2e11-4bcd-8f31-669ff692688f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1283644084',display_name='tempest-TestVolumeBootPattern-server-1283644084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1283644084',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:58:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-zt71lby5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:58:06Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=8331e32c-2e11-4bcd-8f31-669ff692688f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "address": "fa:16:3e:77:51:81", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb27b4556-b6", "ovs_interfaceid": "b27b4556-b692-4099-88f9-7519d6c2a6d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:51:81,bridge_name='br-int',has_traffic_filtering=True,id=b27b4556-b692-4099-88f9-7519d6c2a6d8,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb27b4556-b6') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_vif [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:51:81,bridge_name='br-int',has_traffic_filtering=True,id=b27b4556-b692-4099-88f9-7519d6c2a6d8,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb27b4556-b6') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb27b4556-b6, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:59:29 user nova-compute[73052]: INFO os_vif [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:51:81,bridge_name='br-int',has_traffic_filtering=True,id=b27b4556-b692-4099-88f9-7519d6c2a6d8,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb27b4556-b6')
Aug 26 14:59:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlHjJTwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:59:29 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be64b26-dfad-48d3-9270-ce602b3618b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1050b5-f695-4e2d-a5d8-448ea4cace7b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:29 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 14:59:29 user nova-compute[73052]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 14:59:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a018a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2731a00-0466-4e0f-9abd-032541c15bb5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b69b85-1c88-4bed-9a57-b13bbaed2428]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf1cc37-9086-4904-a625-03ae3b7a1fcd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[015219e8-3c56-400e-ada7-a0e2cc940ba3]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:59:29 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_88aabe13', '/dev/disk/by-id/scsi-1SCST_BIO88aabe13-1a0783732983e033', '/dev/disk/by-id/scsi-23161303738333733') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f6aecf-b9eb-4873-8889-d88c3f91f34f]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa70a7c-557e-4a54-8ab6-59517f864e39]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d60796e-e4c9-49a8-b842-a20a8d39e304]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260]
Aug 26 14:59:30 user nova-compute[73052]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260] successful.
Aug 26 14:59:30 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ea7d3a-f8a9-4188-8fe9-9a91f537c702]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== disconnect_volume: return (278ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:59:30 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Deleting instance files /opt/stack/data/nova/instances/8331e32c-2e11-4bcd-8f31-669ff692688f_del
Aug 26 14:59:30 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Deletion of /opt/stack/data/nova/instances/8331e32c-2e11-4bcd-8f31-669ff692688f_del complete
Aug 26 14:59:30 user nova-compute[73052]: INFO nova.compute.manager [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received event network-vif-unplugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] Acquiring lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] No waiting events found dispatching network-vif-unplugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received event network-vif-unplugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received event network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] Acquiring lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] No waiting events found dispatching network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:59:30 user nova-compute[73052]: WARNING nova.compute.manager [req-74316a3f-7b02-4182-9389-b19b57aaf48d req-f5d2bb9d-b0b3-4c7c-b3f5-f741fd8abbac service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received unexpected event network-vif-plugged-b27b4556-b692-4099-88f9-7519d6c2a6d8 for instance with vm_state active and task_state deleting.
Aug 26 14:59:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:31 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:59:31 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Took 1.01 seconds to deallocate network for instance.
Aug 26 14:59:31 user nova-compute[73052]: INFO nova.compute.manager [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Took 0.78 seconds to detach 1 volumes for instance.
Aug 26 14:59:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:59:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:59:32 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:59:32 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:59:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-80ed9d50-fe1d-48f6-a3aa-708a0761793d req-d6bc9d43-61b8-42a7-87bc-5448dec9cd59 service nova] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Received event network-vif-deleted-b27b4556-b692-4099-88f9-7519d6c2a6d8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:59:32 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Deleted allocations for instance 8331e32c-2e11-4bcd-8f31-669ff692688f
Aug 26 14:59:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8d8c301d-d883-4817-8f14-4ea1738667ff tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "8331e32c-2e11-4bcd-8f31-669ff692688f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.356s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:59:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:44 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693061969.794525, 8331e32c-2e11-4bcd-8f31-669ff692688f => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:59:44 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] VM Stopped (Lifecycle Event)
Aug 26 14:59:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-24fa310c-dd8d-4bcf-a054-92145ae6944e None None] [instance: 8331e32c-2e11-4bcd-8f31-669ff692688f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:59:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:59:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:59:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:59:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:59:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:59:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:00:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:00:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:00:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:07 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:00:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updating instance_info_cache with network_info: [{"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-4a45b34c-d927-4a7e-b71a-fa665269cdc0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:00:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:00:10 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:11 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:00:13 user nova-compute[73052]: INFO nova.compute.claims [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Claim successful on node user
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:00:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.policy [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '182f8d861f1d422aaa2ac5fbd8442f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec12a3cd3b3b4b13a00609468911ab32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:00:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Creating image(s)
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "/opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "/opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk 1073741824" returned: 0 in 0.054s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Successfully created port: f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Cannot resize image /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Ensure instance console log exists: /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:00:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Successfully updated port: f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquired lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-b5638599-514b-47d5-874e-cc419c25f6c4 req-60d1cabb-1b15-4573-96bf-745815be97c2 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received event network-changed-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-b5638599-514b-47d5-874e-cc419c25f6c4 req-60d1cabb-1b15-4573-96bf-745815be97c2 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Refreshing instance network info cache due to event network-changed-f2f6d721-3205-487b-9d64-73be2b946d5d. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5638599-514b-47d5-874e-cc419c25f6c4 req-60d1cabb-1b15-4573-96bf-745815be97c2 service nova] Acquiring lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Updating instance_info_cache with network_info: [{"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Releasing lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Instance network_info: |[{"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5638599-514b-47d5-874e-cc419c25f6c4 req-60d1cabb-1b15-4573-96bf-745815be97c2 service nova] Acquired lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-b5638599-514b-47d5-874e-cc419c25f6c4 req-60d1cabb-1b15-4573-96bf-745815be97c2 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Refreshing network info cache for port f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Start _get_guest_xml network_info=[{"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:00:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:00:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-596244850',display_name='tempest-VolumesSnapshotTestJSON-instance-596244850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-596244850',id=38,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkNoMy3Ut/2ZjanoXBXdYM24nmfbtDlvGSedSntBt6X8ySw/rKGWhsai/Cg7V7Wu6gO2hC//57bYl5cURIkVk1zopTsF22QohotgNFgG4MO7BlpP53SzTBkLpUyRzo9EQ==',key_name='tempest-keypair-821469525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec12a3cd3b3b4b13a00609468911ab32',ramdisk_id='',reservation_id='r-s0avpm0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2099506189',owner_user_name='tempest-VolumesSnapshotTestJSON-2099506189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182f8d861f1d422aaa2ac5fbd8442f7f',uuid=8a75e8d1-668a-4014-a476-a2e3730f01a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converting VIF {"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:5a:2e,bridge_name='br-int',has_traffic_filtering=True,id=f2f6d721-3205-487b-9d64-73be2b946d5d,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f6d721-32') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.objects.instance [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a75e8d1-668a-4014-a476-a2e3730f01a8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:00:15 user nova-compute[73052]:   <uuid>8a75e8d1-668a-4014-a476-a2e3730f01a8</uuid>
Aug 26 15:00:15 user nova-compute[73052]:   <name>instance-00000026</name>
Aug 26 15:00:15 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:00:15 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:00:15 user nova-compute[73052]:   <metadata>
Aug 26 15:00:15 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:00:15 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:00:15 user nova-compute[73052]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-596244850</nova:name>
Aug 26 15:00:15 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:00:15</nova:creationTime>
Aug 26 15:00:15 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:00:15 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:00:15 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:00:15 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:00:15 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:00:15 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:00:15 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:00:15 user nova-compute[73052]:       <nova:owner>
Aug 26 15:00:15 user nova-compute[73052]:         <nova:user uuid="182f8d861f1d422aaa2ac5fbd8442f7f">tempest-VolumesSnapshotTestJSON-2099506189-project-member</nova:user>
Aug 26 15:00:15 user nova-compute[73052]:         <nova:project uuid="ec12a3cd3b3b4b13a00609468911ab32">tempest-VolumesSnapshotTestJSON-2099506189</nova:project>
Aug 26 15:00:15 user nova-compute[73052]:       </nova:owner>
Aug 26 15:00:15 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:00:15 user nova-compute[73052]:       <nova:ports>
Aug 26 15:00:15 user nova-compute[73052]:         <nova:port uuid="f2f6d721-3205-487b-9d64-73be2b946d5d">
Aug 26 15:00:15 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 15:00:15 user nova-compute[73052]:         </nova:port>
Aug 26 15:00:15 user nova-compute[73052]:       </nova:ports>
Aug 26 15:00:15 user nova-compute[73052]:     </nova:instance>
Aug 26 15:00:15 user nova-compute[73052]:   </metadata>
Aug 26 15:00:15 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:00:15 user nova-compute[73052]:     <system>
Aug 26 15:00:15 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:00:15 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:00:15 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:00:15 user nova-compute[73052]:       <entry name="serial">8a75e8d1-668a-4014-a476-a2e3730f01a8</entry>
Aug 26 15:00:15 user nova-compute[73052]:       <entry name="uuid">8a75e8d1-668a-4014-a476-a2e3730f01a8</entry>
Aug 26 15:00:15 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:00:15 user nova-compute[73052]:     </system>
Aug 26 15:00:15 user nova-compute[73052]:   </sysinfo>
Aug 26 15:00:15 user nova-compute[73052]:   <os>
Aug 26 15:00:15 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:00:15 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:00:15 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:00:15 user nova-compute[73052]:   </os>
Aug 26 15:00:15 user nova-compute[73052]:   <features>
Aug 26 15:00:15 user nova-compute[73052]:     <acpi/>
Aug 26 15:00:15 user nova-compute[73052]:     <apic/>
Aug 26 15:00:15 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:00:15 user nova-compute[73052]:   </features>
Aug 26 15:00:15 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:00:15 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:00:15 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:00:15 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:00:15 user nova-compute[73052]:   </clock>
Aug 26 15:00:15 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:00:15 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:00:15 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:00:15 user nova-compute[73052]:   </cpu>
Aug 26 15:00:15 user nova-compute[73052]:   <devices>
Aug 26 15:00:15 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:00:15 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:00:15 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk"/>
Aug 26 15:00:15 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:00:15 user nova-compute[73052]:     </disk>
Aug 26 15:00:15 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:00:15 user nova-compute[73052]:       <mac address="fa:16:3e:2f:5a:2e"/>
Aug 26 15:00:15 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:00:15 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:00:15 user nova-compute[73052]:       <target dev="tapf2f6d721-32"/>
Aug 26 15:00:15 user nova-compute[73052]:     </interface>
Aug 26 15:00:15 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:00:15 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/console.log" append="off"/>
Aug 26 15:00:15 user nova-compute[73052]:     </serial>
Aug 26 15:00:15 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:00:15 user nova-compute[73052]:     <video>
Aug 26 15:00:15 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:00:15 user nova-compute[73052]:     </video>
Aug 26 15:00:15 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:00:15 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:00:15 user nova-compute[73052]:     </rng>
Aug 26 15:00:15 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:00:15 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:00:15 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:00:15 user nova-compute[73052]:     </memballoon>
Aug 26 15:00:15 user nova-compute[73052]:   </devices>
Aug 26 15:00:15 user nova-compute[73052]: </domain>
Aug 26 15:00:15 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-596244850',display_name='tempest-VolumesSnapshotTestJSON-instance-596244850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-596244850',id=38,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkNoMy3Ut/2ZjanoXBXdYM24nmfbtDlvGSedSntBt6X8ySw/rKGWhsai/Cg7V7Wu6gO2hC//57bYl5cURIkVk1zopTsF22QohotgNFgG4MO7BlpP53SzTBkLpUyRzo9EQ==',key_name='tempest-keypair-821469525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec12a3cd3b3b4b13a00609468911ab32',ramdisk_id='',reservation_id='r-s0avpm0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2099506189',owner_user_name='tempest-VolumesSnapshotTestJSON-2099506189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182f8d861f1d422aaa2ac5fbd8442f7f',uuid=8a75e8d1-668a-4014-a476-a2e3730f01a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converting VIF {"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:5a:2e,bridge_name='br-int',has_traffic_filtering=True,id=f2f6d721-3205-487b-9d64-73be2b946d5d,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f6d721-32') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG os_vif [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:5a:2e,bridge_name='br-int',has_traffic_filtering=True,id=f2f6d721-3205-487b-9d64-73be2b946d5d,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f6d721-32') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2f6d721-32, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2f6d721-32, col_values=(('external_ids', {'iface-id': 'f2f6d721-3205-487b-9d64-73be2b946d5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:5a:2e', 'vm-uuid': '8a75e8d1-668a-4014-a476-a2e3730f01a8'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:15 user nova-compute[73052]: INFO os_vif [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:5a:2e,bridge_name='br-int',has_traffic_filtering=True,id=f2f6d721-3205-487b-9d64-73be2b946d5d,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f6d721-32')
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No VIF found with MAC fa:16:3e:2f:5a:2e, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-b5638599-514b-47d5-874e-cc419c25f6c4 req-60d1cabb-1b15-4573-96bf-745815be97c2 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Updated VIF entry in instance network info cache for port f2f6d721-3205-487b-9d64-73be2b946d5d. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-b5638599-514b-47d5-874e-cc419c25f6c4 req-60d1cabb-1b15-4573-96bf-745815be97c2 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Updating instance_info_cache with network_info: [{"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b5638599-514b-47d5-874e-cc419c25f6c4 req-60d1cabb-1b15-4573-96bf-745815be97c2 service nova] Releasing lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-313bdf20-99fe-4cc1-8454-64b0ec8434a9 req-4965e5eb-17ff-4513-92d1-dbf5554ec7c7 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received event network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-313bdf20-99fe-4cc1-8454-64b0ec8434a9 req-4965e5eb-17ff-4513-92d1-dbf5554ec7c7 service nova] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-313bdf20-99fe-4cc1-8454-64b0ec8434a9 req-4965e5eb-17ff-4513-92d1-dbf5554ec7c7 service nova] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-313bdf20-99fe-4cc1-8454-64b0ec8434a9 req-4965e5eb-17ff-4513-92d1-dbf5554ec7c7 service nova] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-313bdf20-99fe-4cc1-8454-64b0ec8434a9 req-4965e5eb-17ff-4513-92d1-dbf5554ec7c7 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] No waiting events found dispatching network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:00:17 user nova-compute[73052]: WARNING nova.compute.manager [req-313bdf20-99fe-4cc1-8454-64b0ec8434a9 req-4965e5eb-17ff-4513-92d1-dbf5554ec7c7 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received unexpected event network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d for instance with vm_state building and task_state spawning.
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:17 user nova-compute[73052]: INFO nova.compute.manager [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Detaching volume 1f672247-4025-40d0-b410-f100dfe0996d
Aug 26 15:00:18 user nova-compute[73052]: INFO nova.virt.block_device [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Attempting to driver detach volume 1f672247-4025-40d0-b410-f100dfe0996d from mountpoint /dev/vdb
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Attempting to detach device vdb from instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:00:18 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:00:18 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:00:18 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:00:18 user nova-compute[73052]:   <serial>1f672247-4025-40d0-b410-f100dfe0996d</serial>
Aug 26 15:00:18 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:00:18 user nova-compute[73052]: </disk>
Aug 26 15:00:18 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Successfully detached device vdb from instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 from the persistent domain config.
Aug 26 15:00:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:00:18 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:00:18 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:00:18 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:00:18 user nova-compute[73052]:   <serial>1f672247-4025-40d0-b410-f100dfe0996d</serial>
Aug 26 15:00:18 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:00:18 user nova-compute[73052]: </disk>
Aug 26 15:00:18 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693062018.5508122, 4a45b34c-d927-4a7e-b71a-fa665269cdc0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:00:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Successfully detached device vdb from instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 from the live domain config.
Aug 26 15:00:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rcHasvKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:00:18 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[00da2255-c4f9-4849-ab13-a79d226a9c29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5f0851-31e7-4025-9828-0cb46147d063]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 15:00:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d (non-flash)
Aug 26 15:00:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0797880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f47f9e-eba2-4b2e-b657-ff188e58d209]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0494c26c-331c-4c55-81fe-a826e5745ab1]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc87f1d3-a5d1-465a-af6d-a6c4e73f0ab9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b417f-ef06-4dd2-a300-c0e722f66d94]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[05131352-9f94-4927-bcd7-e3f37a8da944]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d280b5-7556-4a94-8b91-de98e7b8bd23]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d, portal: 172.16.0.220,3260]
Aug 26 15:00:18 user nova-compute[73052]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d, portal: 172.16.0.220,3260] successful.
Aug 26 15:00:18 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f672247-4025-40d0-b410-f100dfe0996d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc577e4a-a9a7-4d6c-a6b0-b5df3651b02d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] <== disconnect_volume: return (315ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062019.0039792, 8a75e8d1-668a-4014-a476-a2e3730f01a8 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:00:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] VM Resumed (Lifecycle Event)
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:00:19 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Instance spawned successfully.
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062019.0048544, 8a75e8d1-668a-4014-a476-a2e3730f01a8 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:00:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] VM Started (Lifecycle Event)
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:00:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-f4f72939-8812-4b72-a3c4-6a627c8491c6 req-10ef1a8f-b854-4d42-8f5a-806825b125a5 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received event network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f4f72939-8812-4b72-a3c4-6a627c8491c6 req-10ef1a8f-b854-4d42-8f5a-806825b125a5 service nova] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f4f72939-8812-4b72-a3c4-6a627c8491c6 req-10ef1a8f-b854-4d42-8f5a-806825b125a5 service nova] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f4f72939-8812-4b72-a3c4-6a627c8491c6 req-10ef1a8f-b854-4d42-8f5a-806825b125a5 service nova] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-f4f72939-8812-4b72-a3c4-6a627c8491c6 req-10ef1a8f-b854-4d42-8f5a-806825b125a5 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] No waiting events found dispatching network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:00:19 user nova-compute[73052]: WARNING nova.compute.manager [req-f4f72939-8812-4b72-a3c4-6a627c8491c6 req-10ef1a8f-b854-4d42-8f5a-806825b125a5 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received unexpected event network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d for instance with vm_state building and task_state spawning.
Aug 26 15:00:19 user nova-compute[73052]: INFO nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 26 15:00:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:19 user nova-compute[73052]: INFO nova.compute.manager [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Took 6.10 seconds to build instance.
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6623f421-564a-4a7c-8041-6f596984e4dd tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.191s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:20 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:00:20 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8136MB free_disk=25.192245483398438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:00:21 user nova-compute[73052]: INFO nova.compute.claims [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Claim successful on node user
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:00:21 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:00:21 user nova-compute[73052]: INFO nova.virt.block_device [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Booting with volume c56e4216-7611-4b65-86aa-66c7e78c46d8 at /dev/vda
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.policy [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce6cd78a2f7c407983d90a15ffb94967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8ab154558a4521920e05921722db36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG os_brick.utils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86804f1-af1c-4845-b478-51006c73dc39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce44864-8d3a-4469-845a-a64dfd3dd506]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8124027e-2e29-4311-a401-f3227c109fca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aebd47-46a8-494b-9392-a35eb7f88b80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:00:21 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:00:21 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa2bcd6-4880-438f-a7ad-a8d1cf9d3820]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG os_brick.utils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:00:21 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updating existing volume attachment record: 7ff0a809-eba5-461c-a991-30bd656fa715 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:00:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Successfully created port: 255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Successfully updated port: 255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquired lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-ca321092-6290-433d-99ca-ad84279f7107 req-643e3753-bbae-4267-8f31-9704bb1bfc49 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-changed-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-ca321092-6290-433d-99ca-ad84279f7107 req-643e3753-bbae-4267-8f31-9704bb1bfc49 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Refreshing instance network info cache due to event network-changed-255a6abb-2603-4ac3-87cb-e7c030792899. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ca321092-6290-433d-99ca-ad84279f7107 req-643e3753-bbae-4267-8f31-9704bb1bfc49 service nova] Acquiring lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG nova.network.neutron [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updating instance_info_cache with network_info: [{"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Releasing lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Instance network_info: |[{"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ca321092-6290-433d-99ca-ad84279f7107 req-643e3753-bbae-4267-8f31-9704bb1bfc49 service nova] Acquired lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:23 user nova-compute[73052]: DEBUG nova.network.neutron [req-ca321092-6290-433d-99ca-ad84279f7107 req-643e3753-bbae-4267-8f31-9704bb1bfc49 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Refreshing network info cache for port 255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:00:24 user nova-compute[73052]: DEBUG nova.network.neutron [req-ca321092-6290-433d-99ca-ad84279f7107 req-643e3753-bbae-4267-8f31-9704bb1bfc49 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updated VIF entry in instance network info cache for port 255a6abb-2603-4ac3-87cb-e7c030792899. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:00:24 user nova-compute[73052]: DEBUG nova.network.neutron [req-ca321092-6290-433d-99ca-ad84279f7107 req-643e3753-bbae-4267-8f31-9704bb1bfc49 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updating instance_info_cache with network_info: [{"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ca321092-6290-433d-99ca-ad84279f7107 req-643e3753-bbae-4267-8f31-9704bb1bfc49 service nova] Releasing lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:00:27 user nova-compute[73052]: DEBUG nova.objects.instance [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lazy-loading 'flavor' on Instance uuid 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:00:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-07a914ed-31e4-460e-8dda-1b89035fbd33 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.771s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:28 user nova-compute[73052]: INFO nova.compute.manager [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] instance snapshotting
Aug 26 15:00:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Beginning live snapshot process
Aug 26 15:00:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json -f qcow2 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json -f qcow2 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.229s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl6ztucje/2086033855f043be8bd8d079e8fdfae8.delta 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl6ztucje/2086033855f043be8bd8d079e8fdfae8.delta 1073741824" returned: 0 in 0.053s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 15:00:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-9392a9d4-79ce-4bbe-a4aa-6ed0219432d9 req-dc9158ea-d45e-4e93-b98b-2eee7a7f00dd service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-changed-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-9392a9d4-79ce-4bbe-a4aa-6ed0219432d9 req-dc9158ea-d45e-4e93-b98b-2eee7a7f00dd service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Refreshing instance network info cache due to event network-changed-3a404e9c-e1ad-4c05-a706-f39084d8a5df. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9392a9d4-79ce-4bbe-a4aa-6ed0219432d9 req-dc9158ea-d45e-4e93-b98b-2eee7a7f00dd service nova] Acquiring lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9392a9d4-79ce-4bbe-a4aa-6ed0219432d9 req-dc9158ea-d45e-4e93-b98b-2eee7a7f00dd service nova] Acquired lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-9392a9d4-79ce-4bbe-a4aa-6ed0219432d9 req-dc9158ea-d45e-4e93-b98b-2eee7a7f00dd service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Refreshing network info cache for port 3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:00:30 user nova-compute[73052]: DEBUG nova.network.neutron [req-9392a9d4-79ce-4bbe-a4aa-6ed0219432d9 req-dc9158ea-d45e-4e93-b98b-2eee7a7f00dd service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updated VIF entry in instance network info cache for port 3a404e9c-e1ad-4c05-a706-f39084d8a5df. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:00:30 user nova-compute[73052]: DEBUG nova.network.neutron [req-9392a9d4-79ce-4bbe-a4aa-6ed0219432d9 req-dc9158ea-d45e-4e93-b98b-2eee7a7f00dd service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updating instance_info_cache with network_info: [{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 15:00:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9392a9d4-79ce-4bbe-a4aa-6ed0219432d9 req-dc9158ea-d45e-4e93-b98b-2eee7a7f00dd service nova] Releasing lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:00:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] COPY block job progress, current cursor: 18612224 final cursor: 75563008 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 15:00:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 15:00:31 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 15:00:31 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 15:00:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl6ztucje/2086033855f043be8bd8d079e8fdfae8.delta /opt/stack/data/nova/instances/snapshots/tmpl6ztucje/2086033855f043be8bd8d079e8fdfae8 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl6ztucje/2086033855f043be8bd8d079e8fdfae8.delta /opt/stack/data/nova/instances/snapshots/tmpl6ztucje/2086033855f043be8bd8d079e8fdfae8" returned: 0 in 0.675s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Snapshot extracted, beginning image upload
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:00:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Creating image(s)
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Ensure instance console log exists: /opt/stack/data/nova/instances/d3fec0a1-6b07-4b0a-9cf1-11cd415a7830/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Start _get_guest_xml network_info=[{"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '7ff0a809-eba5-461c-a991-30bd656fa715', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlHjJTwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3fec0a1-6b07-4b0a-9cf1-11cd415a7830', 'attached_at': '', 'detached_at': '', 'volume_id': 'c56e4216-7611-4b65-86aa-66c7e78c46d8', 'serial': 'c56e4216-7611-4b65-86aa-66c7e78c46d8'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:00:32 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:00:32 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlHjJTwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:00:32 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:00:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:00:32 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:00:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:00:32 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:00:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[04365da2-e326-4a4e-9d40-b831caaa5306]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:00:32 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a75334-c7db-4935-8ca4-cf380df2cf7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8] added
Aug 26 15:00:33 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a34e0f-be7f-46ee-8f7b-f4b1d6a81402]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a727df-99f2-416b-a41c-c375e93ad8a3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlHjJTwa {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlHjJTwa" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca2f7c-85f8-42eb-b498-7d797223ffc1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlHjJTwa'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f8bd38-1733-4497-8104-ae7af255134e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c3b57-a593-45c6-b1af-cf9e3c993e76]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:00:33 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:00:33 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:00:33 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:00:33 user nova-compute[73052]: 
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[749400e7-492f-4885-a667-308171fa006f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260]
Aug 26 15:00:33 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260] successful.
Aug 26 15:00:33 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea6e19b-55d9-424a-aebb-e9ff4924452e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74ec43b-4af6-4c76-ae14-f40786e57717]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:00:33 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:00:33 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e073e-7d08-45f8-a0a1-53c2084fc824]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:00:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlHjJTwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23161303738333733', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161303738333733', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1667280266',display_name='tempest-TestVolumeBootPattern-server-1667280266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1667280266',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-b9t3ir4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:22Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=d3fec0a1-6b07-4b0a-9cf1-11cd415a7830,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=255a6abb-2603-4ac3-87cb-e7c030792899,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255a6abb-26') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.objects.instance [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'pci_devices' on Instance uuid d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:00:34 user nova-compute[73052]:   <uuid>d3fec0a1-6b07-4b0a-9cf1-11cd415a7830</uuid>
Aug 26 15:00:34 user nova-compute[73052]:   <name>instance-00000027</name>
Aug 26 15:00:34 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:00:34 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:00:34 user nova-compute[73052]:   <metadata>
Aug 26 15:00:34 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:00:34 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:00:34 user nova-compute[73052]:       <nova:name>tempest-TestVolumeBootPattern-server-1667280266</nova:name>
Aug 26 15:00:34 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:00:32</nova:creationTime>
Aug 26 15:00:34 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:00:34 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:00:34 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:00:34 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:00:34 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:00:34 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:00:34 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:00:34 user nova-compute[73052]:       <nova:owner>
Aug 26 15:00:34 user nova-compute[73052]:         <nova:user uuid="ce6cd78a2f7c407983d90a15ffb94967">tempest-TestVolumeBootPattern-772605316-project-member</nova:user>
Aug 26 15:00:34 user nova-compute[73052]:         <nova:project uuid="1e8ab154558a4521920e05921722db36">tempest-TestVolumeBootPattern-772605316</nova:project>
Aug 26 15:00:34 user nova-compute[73052]:       </nova:owner>
Aug 26 15:00:34 user nova-compute[73052]:       <nova:ports>
Aug 26 15:00:34 user nova-compute[73052]:         <nova:port uuid="255a6abb-2603-4ac3-87cb-e7c030792899">
Aug 26 15:00:34 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 15:00:34 user nova-compute[73052]:         </nova:port>
Aug 26 15:00:34 user nova-compute[73052]:       </nova:ports>
Aug 26 15:00:34 user nova-compute[73052]:     </nova:instance>
Aug 26 15:00:34 user nova-compute[73052]:   </metadata>
Aug 26 15:00:34 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:00:34 user nova-compute[73052]:     <system>
Aug 26 15:00:34 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:00:34 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:00:34 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:00:34 user nova-compute[73052]:       <entry name="serial">d3fec0a1-6b07-4b0a-9cf1-11cd415a7830</entry>
Aug 26 15:00:34 user nova-compute[73052]:       <entry name="uuid">d3fec0a1-6b07-4b0a-9cf1-11cd415a7830</entry>
Aug 26 15:00:34 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:00:34 user nova-compute[73052]:     </system>
Aug 26 15:00:34 user nova-compute[73052]:   </sysinfo>
Aug 26 15:00:34 user nova-compute[73052]:   <os>
Aug 26 15:00:34 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:00:34 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:00:34 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:00:34 user nova-compute[73052]:   </os>
Aug 26 15:00:34 user nova-compute[73052]:   <features>
Aug 26 15:00:34 user nova-compute[73052]:     <acpi/>
Aug 26 15:00:34 user nova-compute[73052]:     <apic/>
Aug 26 15:00:34 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:00:34 user nova-compute[73052]:   </features>
Aug 26 15:00:34 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:00:34 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:00:34 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:00:34 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:00:34 user nova-compute[73052]:   </clock>
Aug 26 15:00:34 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:00:34 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:00:34 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:00:34 user nova-compute[73052]:   </cpu>
Aug 26 15:00:34 user nova-compute[73052]:   <devices>
Aug 26 15:00:34 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:00:34 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:00:34 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 15:00:34 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:00:34 user nova-compute[73052]:       <serial>c56e4216-7611-4b65-86aa-66c7e78c46d8</serial>
Aug 26 15:00:34 user nova-compute[73052]:     </disk>
Aug 26 15:00:34 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:00:34 user nova-compute[73052]:       <mac address="fa:16:3e:42:6a:c4"/>
Aug 26 15:00:34 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:00:34 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:00:34 user nova-compute[73052]:       <target dev="tap255a6abb-26"/>
Aug 26 15:00:34 user nova-compute[73052]:     </interface>
Aug 26 15:00:34 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:00:34 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/d3fec0a1-6b07-4b0a-9cf1-11cd415a7830/console.log" append="off"/>
Aug 26 15:00:34 user nova-compute[73052]:     </serial>
Aug 26 15:00:34 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:00:34 user nova-compute[73052]:     <video>
Aug 26 15:00:34 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:00:34 user nova-compute[73052]:     </video>
Aug 26 15:00:34 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:00:34 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:00:34 user nova-compute[73052]:     </rng>
Aug 26 15:00:34 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:00:34 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:00:34 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:00:34 user nova-compute[73052]:     </memballoon>
Aug 26 15:00:34 user nova-compute[73052]:   </devices>
Aug 26 15:00:34 user nova-compute[73052]: </domain>
Aug 26 15:00:34 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1667280266',display_name='tempest-TestVolumeBootPattern-server-1667280266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1667280266',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-b9t3ir4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:22Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=d3fec0a1-6b07-4b0a-9cf1-11cd415a7830,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=255a6abb-2603-4ac3-87cb-e7c030792899,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255a6abb-26') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG os_vif [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=255a6abb-2603-4ac3-87cb-e7c030792899,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255a6abb-26') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap255a6abb-26, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap255a6abb-26, col_values=(('external_ids', {'iface-id': '255a6abb-2603-4ac3-87cb-e7c030792899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:6a:c4', 'vm-uuid': 'd3fec0a1-6b07-4b0a-9cf1-11cd415a7830'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:34 user nova-compute[73052]: INFO os_vif [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=255a6abb-2603-4ac3-87cb-e7c030792899,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255a6abb-26')
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:00:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No VIF found with MAC fa:16:3e:42:6a:c4, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:00:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Snapshot image upload complete
Aug 26 15:00:34 user nova-compute[73052]: INFO nova.compute.manager [None req-b1396618-277b-4789-974f-75f5ef49df8a tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Took 5.94 seconds to snapshot the instance on the hypervisor.
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG nova.objects.instance [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:35 user nova-compute[73052]: INFO nova.compute.manager [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Attaching volume 529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 to /dev/vdb
Aug 26 15:00:35 user nova-compute[73052]: DEBUG os_brick.utils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8d88a5-7e7a-4878-b1c0-17a83c4b6ff1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd174c47-84ad-4506-9914-8155d2c686c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa515ad-a504-4a62-a368-1d6e4087e089]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a11ed8e-16bd-45f4-9063-e0807caa14f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:00:35 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:00:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[701f5e4a-5bb3-4c56-845c-c4cca3749d2f]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG os_brick.utils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updating existing volume attachment record: a7dcfc57-f864-4da8-ae78-bb9bd4f8f5cc {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:00:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-8ebafbde-a626-49a3-9018-73627d7fe0f4 req-d3864f3a-30fe-4c3d-95b3-4c91d716b086 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8ebafbde-a626-49a3-9018-73627d7fe0f4 req-d3864f3a-30fe-4c3d-95b3-4c91d716b086 service nova] Acquiring lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8ebafbde-a626-49a3-9018-73627d7fe0f4 req-d3864f3a-30fe-4c3d-95b3-4c91d716b086 service nova] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8ebafbde-a626-49a3-9018-73627d7fe0f4 req-d3864f3a-30fe-4c3d-95b3-4c91d716b086 service nova] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-8ebafbde-a626-49a3-9018-73627d7fe0f4 req-d3864f3a-30fe-4c3d-95b3-4c91d716b086 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] No waiting events found dispatching network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:00:36 user nova-compute[73052]: WARNING nova.compute.manager [req-8ebafbde-a626-49a3-9018-73627d7fe0f4 req-d3864f3a-30fe-4c3d-95b3-4c91d716b086 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received unexpected event network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 for instance with vm_state building and task_state spawning.
Aug 26 15:00:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:36 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:00:36 user nova-compute[73052]: INFO nova.compute.claims [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Claim successful on node user
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:00:37 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.policy [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2625163eb644872b43a7914dcca366b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfbc7f8018b4fd29aa4a2f246a85c11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:00:37 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Creating image(s)
Aug 26 15:00:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "/opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "/opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "/opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "3c965ba2a43d5d96dcb3b03ad64e9582adf85391" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "3c965ba2a43d5d96dcb3b03ad64e9582adf85391" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Successfully created port: 60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062037.9016423, d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:00:38 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] VM Resumed (Lifecycle Event)
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-cb9d2981-7cd3-4af7-a6ff-28ca6dfa0461 req-8f671806-0b35-4754-8a39-f93237e26f25 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cb9d2981-7cd3-4af7-a6ff-28ca6dfa0461 req-8f671806-0b35-4754-8a39-f93237e26f25 service nova] Acquiring lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cb9d2981-7cd3-4af7-a6ff-28ca6dfa0461 req-8f671806-0b35-4754-8a39-f93237e26f25 service nova] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cb9d2981-7cd3-4af7-a6ff-28ca6dfa0461 req-8f671806-0b35-4754-8a39-f93237e26f25 service nova] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-cb9d2981-7cd3-4af7-a6ff-28ca6dfa0461 req-8f671806-0b35-4754-8a39-f93237e26f25 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] No waiting events found dispatching network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:00:38 user nova-compute[73052]: WARNING nova.compute.manager [req-cb9d2981-7cd3-4af7-a6ff-28ca6dfa0461 req-8f671806-0b35-4754-8a39-f93237e26f25 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received unexpected event network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 for instance with vm_state building and task_state spawning.
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:00:38 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Instance spawned successfully.
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:38 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062037.9024098, d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:00:38 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] VM Started (Lifecycle Event)
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:00:38 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391.part --force-share --output=json" returned: 0 in 0.224s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.virt.images [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] 9c2edd5e-6c24-4c58-8117-212b3fd9dd27 was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391.part /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:38 user nova-compute[73052]: INFO nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 26 15:00:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:38 user nova-compute[73052]: INFO nova.compute.manager [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Took 17.70 seconds to build instance.
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-2e692366-c82f-4c47-b280-9baac894c4c5 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.864s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391.part /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391.converted" returned: 0 in 0.385s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391.converted --force-share --output=json" returned: 0 in 0.409s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "3c965ba2a43d5d96dcb3b03ad64e9582adf85391" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.832s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391 --force-share --output=json" returned: 0 in 0.238s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "3c965ba2a43d5d96dcb3b03ad64e9582adf85391" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "3c965ba2a43d5d96dcb3b03ad64e9582adf85391" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Successfully updated port: 60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquired lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2c7e7a4c-1b46-47ce-ba35-ce36205e639a req-3b5ca157-7216-4626-99e8-dfc5d2b063af service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-changed-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2c7e7a4c-1b46-47ce-ba35-ce36205e639a req-3b5ca157-7216-4626-99e8-dfc5d2b063af service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Refreshing instance network info cache due to event network-changed-60cc7257-0309-4a6a-acc5-4af2cb1afc86. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2c7e7a4c-1b46-47ce-ba35-ce36205e639a req-3b5ca157-7216-4626-99e8-dfc5d2b063af service nova] Acquiring lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391 --force-share --output=json" returned: 0 in 0.226s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391,backing_fmt=raw /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391,backing_fmt=raw /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk 1073741824" returned: 0 in 0.066s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "3c965ba2a43d5d96dcb3b03ad64e9582adf85391" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391 --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391 --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Ensure instance console log exists: /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updating instance_info_cache with network_info: [{"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Releasing lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Instance network_info: |[{"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2c7e7a4c-1b46-47ce-ba35-ce36205e639a req-3b5ca157-7216-4626-99e8-dfc5d2b063af service nova] Acquired lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-2c7e7a4c-1b46-47ce-ba35-ce36205e639a req-3b5ca157-7216-4626-99e8-dfc5d2b063af service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Refreshing network info cache for port 60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Start _get_guest_xml network_info=[{"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='575763d517164aafaacd9b9ce472bc08',container_format='bare',created_at=2023-08-26T15:00:28Z,direct_url=<?>,disk_format='qcow2',id=9c2edd5e-6c24-4c58-8117-212b3fd9dd27,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1003476351',owner='8dfbc7f8018b4fd29aa4a2f246a85c11',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T15:00:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': '9c2edd5e-6c24-4c58-8117-212b3fd9dd27'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:00:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:00:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='575763d517164aafaacd9b9ce472bc08',container_format='bare',created_at=2023-08-26T15:00:28Z,direct_url=<?>,disk_format='qcow2',id=9c2edd5e-6c24-4c58-8117-212b3fd9dd27,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1003476351',owner='8dfbc7f8018b4fd29aa4a2f246a85c11',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T15:00:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2085795273',display_name='tempest-TestStampPattern-server-2085795273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2085795273',id=40,image_ref='9c2edd5e-6c24-4c58-8117-212b3fd9dd27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQexKIMfesKSv2hoelfaNzG2QIHClVDFpvVqLXF9gD62XnTHDVnS3avo8uiqbd9zSMsB18mkPPWxAFIuiGViQSleqODN9ZqAbPTDcng8pgHyinnPi9agAubqw/jrXpO7g==',key_name='tempest-TestStampPattern-1713822412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfbc7f8018b4fd29aa4a2f246a85c11',ramdisk_id='',reservation_id='r-v6h1yi02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='de1ab010-f0e3-48c7-bc42-b2bb5746cc13',image_min_disk='1',image_min_ram='0',image_owner_id='8dfbc7f8018b4fd29aa4a2f246a85c11',image_owner_project_name='tempest-TestStampPattern-1398027688',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1398027688-project-member',image_user_id='d2625163eb644872b43a7914dcca366b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1398027688',owner_user_name='tempest-TestStampPattern-1398027688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:37Z,user_data=None,user_id='d2625163eb644872b43a7914dcca366b',uuid=27d11424-e15f-4561-84d0-82827ac35efd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converting VIF {"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=60cc7257-0309-4a6a-acc5-4af2cb1afc86,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60cc7257-03') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'pci_devices' on Instance uuid 27d11424-e15f-4561-84d0-82827ac35efd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:00:40 user nova-compute[73052]:   <uuid>27d11424-e15f-4561-84d0-82827ac35efd</uuid>
Aug 26 15:00:40 user nova-compute[73052]:   <name>instance-00000028</name>
Aug 26 15:00:40 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:00:40 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:00:40 user nova-compute[73052]:   <metadata>
Aug 26 15:00:40 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:00:40 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:00:40 user nova-compute[73052]:       <nova:name>tempest-TestStampPattern-server-2085795273</nova:name>
Aug 26 15:00:40 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:00:40</nova:creationTime>
Aug 26 15:00:40 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:00:40 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:00:40 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:00:40 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:00:40 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:00:40 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:00:40 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:00:40 user nova-compute[73052]:       <nova:owner>
Aug 26 15:00:40 user nova-compute[73052]:         <nova:user uuid="d2625163eb644872b43a7914dcca366b">tempest-TestStampPattern-1398027688-project-member</nova:user>
Aug 26 15:00:40 user nova-compute[73052]:         <nova:project uuid="8dfbc7f8018b4fd29aa4a2f246a85c11">tempest-TestStampPattern-1398027688</nova:project>
Aug 26 15:00:40 user nova-compute[73052]:       </nova:owner>
Aug 26 15:00:40 user nova-compute[73052]:       <nova:root type="image" uuid="9c2edd5e-6c24-4c58-8117-212b3fd9dd27"/>
Aug 26 15:00:40 user nova-compute[73052]:       <nova:ports>
Aug 26 15:00:40 user nova-compute[73052]:         <nova:port uuid="60cc7257-0309-4a6a-acc5-4af2cb1afc86">
Aug 26 15:00:40 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 15:00:40 user nova-compute[73052]:         </nova:port>
Aug 26 15:00:40 user nova-compute[73052]:       </nova:ports>
Aug 26 15:00:40 user nova-compute[73052]:     </nova:instance>
Aug 26 15:00:40 user nova-compute[73052]:   </metadata>
Aug 26 15:00:40 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:00:40 user nova-compute[73052]:     <system>
Aug 26 15:00:40 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:00:40 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:00:40 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:00:40 user nova-compute[73052]:       <entry name="serial">27d11424-e15f-4561-84d0-82827ac35efd</entry>
Aug 26 15:00:40 user nova-compute[73052]:       <entry name="uuid">27d11424-e15f-4561-84d0-82827ac35efd</entry>
Aug 26 15:00:40 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:00:40 user nova-compute[73052]:     </system>
Aug 26 15:00:40 user nova-compute[73052]:   </sysinfo>
Aug 26 15:00:40 user nova-compute[73052]:   <os>
Aug 26 15:00:40 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:00:40 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:00:40 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:00:40 user nova-compute[73052]:   </os>
Aug 26 15:00:40 user nova-compute[73052]:   <features>
Aug 26 15:00:40 user nova-compute[73052]:     <acpi/>
Aug 26 15:00:40 user nova-compute[73052]:     <apic/>
Aug 26 15:00:40 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:00:40 user nova-compute[73052]:   </features>
Aug 26 15:00:40 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:00:40 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:00:40 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:00:40 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:00:40 user nova-compute[73052]:   </clock>
Aug 26 15:00:40 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:00:40 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:00:40 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:00:40 user nova-compute[73052]:   </cpu>
Aug 26 15:00:40 user nova-compute[73052]:   <devices>
Aug 26 15:00:40 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:00:40 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:00:40 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk"/>
Aug 26 15:00:40 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:00:40 user nova-compute[73052]:     </disk>
Aug 26 15:00:40 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:00:40 user nova-compute[73052]:       <mac address="fa:16:3e:14:cc:48"/>
Aug 26 15:00:40 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:00:40 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:00:40 user nova-compute[73052]:       <target dev="tap60cc7257-03"/>
Aug 26 15:00:40 user nova-compute[73052]:     </interface>
Aug 26 15:00:40 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:00:40 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/console.log" append="off"/>
Aug 26 15:00:40 user nova-compute[73052]:     </serial>
Aug 26 15:00:40 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:00:40 user nova-compute[73052]:     <video>
Aug 26 15:00:40 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:00:40 user nova-compute[73052]:     </video>
Aug 26 15:00:40 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:00:40 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:00:40 user nova-compute[73052]:     </rng>
Aug 26 15:00:40 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:00:40 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:00:40 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:00:40 user nova-compute[73052]:     </memballoon>
Aug 26 15:00:40 user nova-compute[73052]:   </devices>
Aug 26 15:00:40 user nova-compute[73052]: </domain>
Aug 26 15:00:40 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2085795273',display_name='tempest-TestStampPattern-server-2085795273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2085795273',id=40,image_ref='9c2edd5e-6c24-4c58-8117-212b3fd9dd27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQexKIMfesKSv2hoelfaNzG2QIHClVDFpvVqLXF9gD62XnTHDVnS3avo8uiqbd9zSMsB18mkPPWxAFIuiGViQSleqODN9ZqAbPTDcng8pgHyinnPi9agAubqw/jrXpO7g==',key_name='tempest-TestStampPattern-1713822412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfbc7f8018b4fd29aa4a2f246a85c11',ramdisk_id='',reservation_id='r-v6h1yi02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='de1ab010-f0e3-48c7-bc42-b2bb5746cc13',image_min_disk='1',image_min_ram='0',image_owner_id='8dfbc7f8018b4fd29aa4a2f246a85c11',image_owner_project_name='tempest-TestStampPattern-1398027688',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1398027688-project-member',image_user_id='d2625163eb644872b43a7914dcca366b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1398027688',owner_user_name='tempest-TestStampPattern-1398027688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:37Z,user_data=None,user_id='d2625163eb644872b43a7914dcca366b',uuid=27d11424-e15f-4561-84d0-82827ac35efd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converting VIF {"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=60cc7257-0309-4a6a-acc5-4af2cb1afc86,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60cc7257-03') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG os_vif [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=60cc7257-0309-4a6a-acc5-4af2cb1afc86,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60cc7257-03') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60cc7257-03, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60cc7257-03, col_values=(('external_ids', {'iface-id': '60cc7257-0309-4a6a-acc5-4af2cb1afc86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:cc:48', 'vm-uuid': '27d11424-e15f-4561-84d0-82827ac35efd'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:40 user nova-compute[73052]: INFO os_vif [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=60cc7257-0309-4a6a-acc5-4af2cb1afc86,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60cc7257-03')
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No VIF found with MAC fa:16:3e:14:cc:48, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-2c7e7a4c-1b46-47ce-ba35-ce36205e639a req-3b5ca157-7216-4626-99e8-dfc5d2b063af service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updated VIF entry in instance network info cache for port 60cc7257-0309-4a6a-acc5-4af2cb1afc86. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-2c7e7a4c-1b46-47ce-ba35-ce36205e639a req-3b5ca157-7216-4626-99e8-dfc5d2b063af service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updating instance_info_cache with network_info: [{"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2c7e7a4c-1b46-47ce-ba35-ce36205e639a req-3b5ca157-7216-4626-99e8-dfc5d2b063af service nova] Releasing lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-308baa1b-3197-4e07-abb1-a75a68fcc5b7 req-a638697f-cfd9-4ca5-8db1-ecf1dbc03361 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-308baa1b-3197-4e07-abb1-a75a68fcc5b7 req-a638697f-cfd9-4ca5-8db1-ecf1dbc03361 service nova] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-308baa1b-3197-4e07-abb1-a75a68fcc5b7 req-a638697f-cfd9-4ca5-8db1-ecf1dbc03361 service nova] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-308baa1b-3197-4e07-abb1-a75a68fcc5b7 req-a638697f-cfd9-4ca5-8db1-ecf1dbc03361 service nova] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:41 user nova-compute[73052]: DEBUG nova.compute.manager [req-308baa1b-3197-4e07-abb1-a75a68fcc5b7 req-a638697f-cfd9-4ca5-8db1-ecf1dbc03361 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] No waiting events found dispatching network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:00:41 user nova-compute[73052]: WARNING nova.compute.manager [req-308baa1b-3197-4e07-abb1-a75a68fcc5b7 req-a638697f-cfd9-4ca5-8db1-ecf1dbc03361 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received unexpected event network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 for instance with vm_state building and task_state spawning.
Aug 26 15:00:43 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062043.9606113, 27d11424-e15f-4561-84d0-82827ac35efd => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:00:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] VM Resumed (Lifecycle Event)
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:00:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Instance spawned successfully.
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:00:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062043.9628701, 27d11424-e15f-4561-84d0-82827ac35efd => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:00:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] VM Started (Lifecycle Event)
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:00:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-50449163-0c40-4757-8f95-eda7bba1c3a6 req-4b4c6a91-bcfd-43b3-915b-2fbc05a4d3f3 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-50449163-0c40-4757-8f95-eda7bba1c3a6 req-4b4c6a91-bcfd-43b3-915b-2fbc05a4d3f3 service nova] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-50449163-0c40-4757-8f95-eda7bba1c3a6 req-4b4c6a91-bcfd-43b3-915b-2fbc05a4d3f3 service nova] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-50449163-0c40-4757-8f95-eda7bba1c3a6 req-4b4c6a91-bcfd-43b3-915b-2fbc05a4d3f3 service nova] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-50449163-0c40-4757-8f95-eda7bba1c3a6 req-4b4c6a91-bcfd-43b3-915b-2fbc05a4d3f3 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] No waiting events found dispatching network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:00:44 user nova-compute[73052]: WARNING nova.compute.manager [req-50449163-0c40-4757-8f95-eda7bba1c3a6 req-4b4c6a91-bcfd-43b3-915b-2fbc05a4d3f3 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received unexpected event network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 for instance with vm_state building and task_state spawning.
Aug 26 15:00:44 user nova-compute[73052]: INFO nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Took 6.97 seconds to spawn the instance on the hypervisor.
Aug 26 15:00:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:44 user nova-compute[73052]: INFO nova.compute.manager [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Took 7.75 seconds to build instance.
Aug 26 15:00:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7c98cae5-c5f7-49c8-8c79-5cfe7caeabd4 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.857s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8089746e-24d8-4792-a97b-62193a2ad808" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:00:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:45 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:00:45 user nova-compute[73052]: INFO nova.compute.claims [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Claim successful on node user
Aug 26 15:00:46 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:00:46 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:00:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:00:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:00:46 user nova-compute[73052]: DEBUG nova.network.neutron [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:00:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:00:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:00:46 user nova-compute[73052]: INFO nova.virt.block_device [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Booting with blank volume at /dev/vda
Aug 26 15:00:46 user nova-compute[73052]: DEBUG nova.policy [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57f5f67238404fb9954260ad90a0a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7051da8614456b9334b146fa3581fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Successfully created port: 96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Successfully updated port: 96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquired lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-68f1a83d-fce7-4d15-a156-905938632bd3 req-e8ce5aa2-7d5d-4ac1-bd07-52dfdfa2ee43 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-changed-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-68f1a83d-fce7-4d15-a156-905938632bd3 req-e8ce5aa2-7d5d-4ac1-bd07-52dfdfa2ee43 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Refreshing instance network info cache due to event network-changed-96001862-3845-4236-8fb5-62a383e8141b. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-68f1a83d-fce7-4d15-a156-905938632bd3 req-e8ce5aa2-7d5d-4ac1-bd07-52dfdfa2ee43 service nova] Acquiring lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:00:47 user nova-compute[73052]: DEBUG nova.network.neutron [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:00:48 user nova-compute[73052]: DEBUG nova.network.neutron [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating instance_info_cache with network_info: [{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Releasing lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance network_info: |[{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:00:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-68f1a83d-fce7-4d15-a156-905938632bd3 req-e8ce5aa2-7d5d-4ac1-bd07-52dfdfa2ee43 service nova] Acquired lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:00:48 user nova-compute[73052]: DEBUG nova.network.neutron [req-68f1a83d-fce7-4d15-a156-905938632bd3 req-e8ce5aa2-7d5d-4ac1-bd07-52dfdfa2ee43 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Refreshing network info cache for port 96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:00:48 user nova-compute[73052]: DEBUG nova.network.neutron [req-68f1a83d-fce7-4d15-a156-905938632bd3 req-e8ce5aa2-7d5d-4ac1-bd07-52dfdfa2ee43 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updated VIF entry in instance network info cache for port 96001862-3845-4236-8fb5-62a383e8141b. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:00:48 user nova-compute[73052]: DEBUG nova.network.neutron [req-68f1a83d-fce7-4d15-a156-905938632bd3 req-e8ce5aa2-7d5d-4ac1-bd07-52dfdfa2ee43 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating instance_info_cache with network_info: [{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:00:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-68f1a83d-fce7-4d15-a156-905938632bd3 req-e8ce5aa2-7d5d-4ac1-bd07-52dfdfa2ee43 service nova] Releasing lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVBnAPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:00:50 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:00:50 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:00:50 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1f309f-c914-435c-bdb1-3eca29a21852]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:00:50 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a4a5f3-e1f5-4d72-92cc-f8ef6688b4b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9] added
Aug 26 15:00:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153308d-303a-4306-81c6-7a1e6b76dfb4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b855c44a-ea90-4d0c-a51c-f385c666a609]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wVBnAPrp {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wVBnAPrp" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfc0dd7-883d-4848-9453-073e8a80ee16]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wVBnAPrp'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[44467660-b8e4-4896-bac4-0336f3f93c85]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ad3c92-5809-44df-908b-c1471b24e5bd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:00:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:00:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[81799a25-99a5-4032-a2fe-09b7f27902d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260]
Aug 26 15:00:50 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260] successful.
Aug 26 15:00:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5524b72-b845-49d0-a90e-6ccd35a9314a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fe08d1-9b11-461e-9e79-e6055bdb9fe4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:00:50 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:00:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:00:50 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:00:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c010aa-c312-4b40-b0d8-71f7702ca9da]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:50 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVBnAPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26436666261356132', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436666261356132', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG nova.objects.instance [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:00:51 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:00:51 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 15:00:51 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:00:51 user nova-compute[73052]:   <serial>529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9</serial>
Aug 26 15:00:51 user nova-compute[73052]: </disk>
Aug 26 15:00:51 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG os_brick.utils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac78df4d-995f-4b54-a8e6-9ae32dd06893]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d82d0b7-ad7c-4792-9211-325fbc2226c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c737a604-971d-4233-ba30-974537a4df3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[671f2b17-20b7-4f34-a15f-b5c99b04e12f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:00:52 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4688672-2b7f-49ac-b61f-aa7ec936d487]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG os_brick.utils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating existing volume attachment record: 897df1a1-8d7e-496a-b81c-f2762dffad97 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No VIF found with MAC fa:16:3e:e8:36:41, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d0aa6b-bebd-48fa-8ff0-e3f5d478b7d9 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.823s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0d814583-febd-4f2c-b39c-717f5456a6c5 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0d814583-febd-4f2c-b39c-717f5456a6c5 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0d814583-febd-4f2c-b39c-717f5456a6c5 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0d814583-febd-4f2c-b39c-717f5456a6c5 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73052) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-0d814583-febd-4f2c-b39c-717f5456a6c5 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb0f2ff1-4290-4ed5-b6d9-3cd7b30b6e59 req-771cb9c3-50f3-411b-81e2-38adb6250d06 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb0f2ff1-4290-4ed5-b6d9-3cd7b30b6e59 req-771cb9c3-50f3-411b-81e2-38adb6250d06 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb0f2ff1-4290-4ed5-b6d9-3cd7b30b6e59 req-771cb9c3-50f3-411b-81e2-38adb6250d06 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb0f2ff1-4290-4ed5-b6d9-3cd7b30b6e59 req-771cb9c3-50f3-411b-81e2-38adb6250d06 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb0f2ff1-4290-4ed5-b6d9-3cd7b30b6e59 req-771cb9c3-50f3-411b-81e2-38adb6250d06 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:00:53 user nova-compute[73052]: WARNING nova.compute.manager [req-bb0f2ff1-4290-4ed5-b6d9-3cd7b30b6e59 req-771cb9c3-50f3-411b-81e2-38adb6250d06 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state active and task_state powering-off.
Aug 26 15:00:53 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance destroyed successfully.
Aug 26 15:00:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0d814583-febd-4f2c-b39c-717f5456a6c5 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:00:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-0d814583-febd-4f2c-b39c-717f5456a6c5 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.872s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:00:55 user nova-compute[73052]: DEBUG nova.compute.manager [req-fd3ea3fc-9a96-4d6e-a8c3-e58eecc7493f req-7d6c8a76-ac0d-487e-882f-d7dab6ff9db8 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:00:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fd3ea3fc-9a96-4d6e-a8c3-e58eecc7493f req-7d6c8a76-ac0d-487e-882f-d7dab6ff9db8 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:00:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fd3ea3fc-9a96-4d6e-a8c3-e58eecc7493f req-7d6c8a76-ac0d-487e-882f-d7dab6ff9db8 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:00:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fd3ea3fc-9a96-4d6e-a8c3-e58eecc7493f req-7d6c8a76-ac0d-487e-882f-d7dab6ff9db8 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:00:55 user nova-compute[73052]: DEBUG nova.compute.manager [req-fd3ea3fc-9a96-4d6e-a8c3-e58eecc7493f req-7d6c8a76-ac0d-487e-882f-d7dab6ff9db8 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:00:55 user nova-compute[73052]: WARNING nova.compute.manager [req-fd3ea3fc-9a96-4d6e-a8c3-e58eecc7493f req-7d6c8a76-ac0d-487e-882f-d7dab6ff9db8 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state None.
Aug 26 15:00:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:01:03 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Creating image(s)
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Ensure instance console log exists: /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Start _get_guest_xml network_info=[{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '897df1a1-8d7e-496a-b81c-f2762dffad97', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmYWiRxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8089746e-24d8-4792-a97b-62193a2ad808', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6d9c6c3-f7b6-4889-87db-24b32d362c2b', 'serial': 'c6d9c6c3-f7b6-4889-87db-24b32d362c2b'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:01:03 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:01:03 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmYWiRxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:01:03 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:01:03 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:01:03 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fcb04d-a33c-4592-bf79-d1f7944e3b77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:01:03 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[384737c9-d964-4f24-bdaf-dd583f6d8d87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b] added
Aug 26 15:01:03 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b42321-ccad-403f-85ee-46b86f641741]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf17156-00b6-42bd-ba04-a27eec5a363e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmYWiRxt {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmYWiRxt" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88df226-91e1-43b4-8ca7-4e439da04364]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QmYWiRxt'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1f72fb-ec7e-4093-aff9-5c3fe7b6610f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3aadfb-a29f-442a-8cbb-d6a34bfbf944]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:01:03 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:01:03 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:01:03 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:01:03 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f76fc-3ed7-45d9-bc9d-15b7124caf06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b, portal: 172.16.0.220,3260]
Aug 26 15:01:03 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b, portal: 172.16.0.220,3260] successful.
Aug 26 15:01:03 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf099cb-3546-41ad-a622-81b1f9a287f1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97e4be8-7f9b-4c54-bd76-b13187b73155]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:01:03 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:01:03 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:01:03 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:01:03 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:01:03 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:01:03 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eb85c5-0b41-4f8e-b16c-658b3ec9ce29]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:01:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmYWiRxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23138666537383639', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138666537383639', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1896647055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1896647055',id=41,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-ubl3jk5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:46Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=8089746e-24d8-4792-a97b-62193a2ad808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:80:11,bridge_name='br-int',has_traffic_filtering=True,id=96001862-3845-4236-8fb5-62a383e8141b,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96001862-38') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.objects.instance [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'pci_devices' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:01:04 user nova-compute[73052]:   <uuid>8089746e-24d8-4792-a97b-62193a2ad808</uuid>
Aug 26 15:01:04 user nova-compute[73052]:   <name>instance-00000029</name>
Aug 26 15:01:04 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:01:04 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:01:04 user nova-compute[73052]:   <metadata>
Aug 26 15:01:04 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:01:04 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:01:04 user nova-compute[73052]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1896647055</nova:name>
Aug 26 15:01:04 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:01:03</nova:creationTime>
Aug 26 15:01:04 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:01:04 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:01:04 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:01:04 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:01:04 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:01:04 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:01:04 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:01:04 user nova-compute[73052]:       <nova:owner>
Aug 26 15:01:04 user nova-compute[73052]:         <nova:user uuid="57f5f67238404fb9954260ad90a0a96d">tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member</nova:user>
Aug 26 15:01:04 user nova-compute[73052]:         <nova:project uuid="fe7051da8614456b9334b146fa3581fd">tempest-ServerBootFromVolumeStableRescueTest-505611186</nova:project>
Aug 26 15:01:04 user nova-compute[73052]:       </nova:owner>
Aug 26 15:01:04 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:01:04 user nova-compute[73052]:       <nova:ports>
Aug 26 15:01:04 user nova-compute[73052]:         <nova:port uuid="96001862-3845-4236-8fb5-62a383e8141b">
Aug 26 15:01:04 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 15:01:04 user nova-compute[73052]:         </nova:port>
Aug 26 15:01:04 user nova-compute[73052]:       </nova:ports>
Aug 26 15:01:04 user nova-compute[73052]:     </nova:instance>
Aug 26 15:01:04 user nova-compute[73052]:   </metadata>
Aug 26 15:01:04 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:01:04 user nova-compute[73052]:     <system>
Aug 26 15:01:04 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:01:04 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:01:04 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:01:04 user nova-compute[73052]:       <entry name="serial">8089746e-24d8-4792-a97b-62193a2ad808</entry>
Aug 26 15:01:04 user nova-compute[73052]:       <entry name="uuid">8089746e-24d8-4792-a97b-62193a2ad808</entry>
Aug 26 15:01:04 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:01:04 user nova-compute[73052]:     </system>
Aug 26 15:01:04 user nova-compute[73052]:   </sysinfo>
Aug 26 15:01:04 user nova-compute[73052]:   <os>
Aug 26 15:01:04 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:01:04 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:01:04 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:01:04 user nova-compute[73052]:   </os>
Aug 26 15:01:04 user nova-compute[73052]:   <features>
Aug 26 15:01:04 user nova-compute[73052]:     <acpi/>
Aug 26 15:01:04 user nova-compute[73052]:     <apic/>
Aug 26 15:01:04 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:01:04 user nova-compute[73052]:   </features>
Aug 26 15:01:04 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:01:04 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:01:04 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:01:04 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:01:04 user nova-compute[73052]:   </clock>
Aug 26 15:01:04 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:01:04 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:01:04 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:01:04 user nova-compute[73052]:   </cpu>
Aug 26 15:01:04 user nova-compute[73052]:   <devices>
Aug 26 15:01:04 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:01:04 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:01:04 user nova-compute[73052]:       <source dev="/dev/sdd"/>
Aug 26 15:01:04 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:01:04 user nova-compute[73052]:       <serial>c6d9c6c3-f7b6-4889-87db-24b32d362c2b</serial>
Aug 26 15:01:04 user nova-compute[73052]:     </disk>
Aug 26 15:01:04 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:01:04 user nova-compute[73052]:       <mac address="fa:16:3e:e8:80:11"/>
Aug 26 15:01:04 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:01:04 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:01:04 user nova-compute[73052]:       <target dev="tap96001862-38"/>
Aug 26 15:01:04 user nova-compute[73052]:     </interface>
Aug 26 15:01:04 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:01:04 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/console.log" append="off"/>
Aug 26 15:01:04 user nova-compute[73052]:     </serial>
Aug 26 15:01:04 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:01:04 user nova-compute[73052]:     <video>
Aug 26 15:01:04 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:01:04 user nova-compute[73052]:     </video>
Aug 26 15:01:04 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:01:04 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:01:04 user nova-compute[73052]:     </rng>
Aug 26 15:01:04 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:01:04 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:01:04 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:01:04 user nova-compute[73052]:     </memballoon>
Aug 26 15:01:04 user nova-compute[73052]:   </devices>
Aug 26 15:01:04 user nova-compute[73052]: </domain>
Aug 26 15:01:04 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1896647055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1896647055',id=41,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-ubl3jk5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:46Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=8089746e-24d8-4792-a97b-62193a2ad808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:80:11,bridge_name='br-int',has_traffic_filtering=True,id=96001862-3845-4236-8fb5-62a383e8141b,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96001862-38') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG os_vif [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:80:11,bridge_name='br-int',has_traffic_filtering=True,id=96001862-3845-4236-8fb5-62a383e8141b,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96001862-38') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96001862-38, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96001862-38, col_values=(('external_ids', {'iface-id': '96001862-3845-4236-8fb5-62a383e8141b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:80:11', 'vm-uuid': '8089746e-24d8-4792-a97b-62193a2ad808'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:01:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:04 user nova-compute[73052]: INFO os_vif [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:80:11,bridge_name='br-int',has_traffic_filtering=True,id=96001862-3845-4236-8fb5-62a383e8141b,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96001862-38')
Aug 26 15:01:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:01:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No VIF found with MAC fa:16:3e:e8:80:11, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:01:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-3b38cc33-6dcd-4cbe-907c-8760121593f6 req-0ec63f14-0f70-4231-966c-8f20e01a6304 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3b38cc33-6dcd-4cbe-907c-8760121593f6 req-0ec63f14-0f70-4231-966c-8f20e01a6304 service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3b38cc33-6dcd-4cbe-907c-8760121593f6 req-0ec63f14-0f70-4231-966c-8f20e01a6304 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3b38cc33-6dcd-4cbe-907c-8760121593f6 req-0ec63f14-0f70-4231-966c-8f20e01a6304 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-3b38cc33-6dcd-4cbe-907c-8760121593f6 req-0ec63f14-0f70-4231-966c-8f20e01a6304 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:01:06 user nova-compute[73052]: WARNING nova.compute.manager [req-3b38cc33-6dcd-4cbe-907c-8760121593f6 req-0ec63f14-0f70-4231-966c-8f20e01a6304 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state building and task_state spawning.
Aug 26 15:01:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.compute.manager [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Terminating instance
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-fabee61e-dd18-4001-b80a-5a58b4ca91d4 req-f47196a6-b56c-4f0a-89f4-31243a5fd5c6 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received event network-vif-unplugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fabee61e-dd18-4001-b80a-5a58b4ca91d4 req-f47196a6-b56c-4f0a-89f4-31243a5fd5c6 service nova] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fabee61e-dd18-4001-b80a-5a58b4ca91d4 req-f47196a6-b56c-4f0a-89f4-31243a5fd5c6 service nova] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fabee61e-dd18-4001-b80a-5a58b4ca91d4 req-f47196a6-b56c-4f0a-89f4-31243a5fd5c6 service nova] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-fabee61e-dd18-4001-b80a-5a58b4ca91d4 req-f47196a6-b56c-4f0a-89f4-31243a5fd5c6 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] No waiting events found dispatching network-vif-unplugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-fabee61e-dd18-4001-b80a-5a58b4ca91d4 req-f47196a6-b56c-4f0a-89f4-31243a5fd5c6 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received event network-vif-unplugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062053.6536748, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Stopped (Lifecycle Event)
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062068.667471, 8089746e-24d8-4792-a97b-62193a2ad808 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] VM Resumed (Lifecycle Event)
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-87989780-82c9-45e0-bfda-3e9477f3468e req-e4a130d4-e066-4b7c-a486-38edd7c60dd0 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-87989780-82c9-45e0-bfda-3e9477f3468e req-e4a130d4-e066-4b7c-a486-38edd7c60dd0 service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-87989780-82c9-45e0-bfda-3e9477f3468e req-e4a130d4-e066-4b7c-a486-38edd7c60dd0 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-87989780-82c9-45e0-bfda-3e9477f3468e req-e4a130d4-e066-4b7c-a486-38edd7c60dd0 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-87989780-82c9-45e0-bfda-3e9477f3468e req-e4a130d4-e066-4b7c-a486-38edd7c60dd0 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:01:08 user nova-compute[73052]: WARNING nova.compute.manager [req-87989780-82c9-45e0-bfda-3e9477f3468e req-e4a130d4-e066-4b7c-a486-38edd7c60dd0 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state building and task_state spawning.
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-99d355bc-7b15-4d40-a753-4bab752e2417 None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance spawned successfully.
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-99d355bc-7b15-4d40-a753-4bab752e2417 None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062068.6724513, 8089746e-24d8-4792-a97b-62193a2ad808 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] VM Started (Lifecycle Event)
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:01:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:01:08 user nova-compute[73052]: INFO nova.compute.manager [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Took 23.24 seconds to build instance.
Aug 26 15:01:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-18e1b779-afe1-4a59-94a0-92b7e82059eb tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8089746e-24d8-4792-a97b-62193a2ad808" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.348s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Instance destroyed successfully.
Aug 26 15:01:09 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lazy-loading 'resources' on Instance uuid 4a45b34c-d927-4a7e-b71a-fa665269cdc0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:56:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1908307852',display_name='tempest-TestServerVolumeAttachmentScenario-server-1908307852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1908307852',id=33,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO5xGjFPV0pgG0JSlcRaCnU3au792bwT1cnj+Kv3splBfk6X+NUXcw7hz3eE3jsmH0MWjIIfZgvsXBkl67dU9qdACdpPj7TiCZ489TmnntSWJWuTm3B39usRqz1ZwIsDg==',key_name='tempest-keypair-343414732',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:56:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98ac26b72a134fb68abdda1a0c860b40',ramdisk_id='',reservation_id='r-aic5m0xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-951083829',owner_user_name='tempest-TestServerVolumeAttachmentScenario-951083829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:56:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3768812de50c4b828c4f5ee45dffb2d9',uuid=4a45b34c-d927-4a7e-b71a-fa665269cdc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Converting VIF {"id": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "address": "fa:16:3e:e5:8e:10", "network": {"id": "66a8815d-7260-4c0c-9068-6ac4fa19888c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1580750361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98ac26b72a134fb68abdda1a0c860b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2143778c-dd", "ovs_interfaceid": "2143778c-ddba-49d1-94fe-ae0a4eb13540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=2143778c-ddba-49d1-94fe-ae0a4eb13540,network=Network(66a8815d-7260-4c0c-9068-6ac4fa19888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2143778c-dd') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG os_vif [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=2143778c-ddba-49d1-94fe-ae0a4eb13540,network=Network(66a8815d-7260-4c0c-9068-6ac4fa19888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2143778c-dd') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2143778c-dd, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:09 user nova-compute[73052]: INFO os_vif [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=2143778c-ddba-49d1-94fe-ae0a4eb13540,network=Network(66a8815d-7260-4c0c-9068-6ac4fa19888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2143778c-dd')
Aug 26 15:01:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Deleting instance files /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0_del
Aug 26 15:01:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Deletion of /opt/stack/data/nova/instances/4a45b34c-d927-4a7e-b71a-fa665269cdc0_del complete
Aug 26 15:01:09 user nova-compute[73052]: INFO nova.compute.manager [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 15:01:09 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:01:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:01:10 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Took 1.36 seconds to deallocate network for instance.
Aug 26 15:01:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-6226947f-d6ee-4b6b-a153-ffc7bdb8a5c7 req-d5820df9-bde2-4faf-89a5-c2d983d5d499 service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received event network-vif-deleted-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-471b2559-3f77-46be-a01e-dce01784dda0 req-03e74987-84ed-43b3-a6f2-6bbc93aff82b service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received event network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-471b2559-3f77-46be-a01e-dce01784dda0 req-03e74987-84ed-43b3-a6f2-6bbc93aff82b service nova] Acquiring lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-471b2559-3f77-46be-a01e-dce01784dda0 req-03e74987-84ed-43b3-a6f2-6bbc93aff82b service nova] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-471b2559-3f77-46be-a01e-dce01784dda0 req-03e74987-84ed-43b3-a6f2-6bbc93aff82b service nova] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-471b2559-3f77-46be-a01e-dce01784dda0 req-03e74987-84ed-43b3-a6f2-6bbc93aff82b service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] No waiting events found dispatching network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:01:10 user nova-compute[73052]: WARNING nova.compute.manager [req-471b2559-3f77-46be-a01e-dce01784dda0 req-03e74987-84ed-43b3-a6f2-6bbc93aff82b service nova] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Received unexpected event network-vif-plugged-2143778c-ddba-49d1-94fe-ae0a4eb13540 for instance with vm_state deleted and task_state None.
Aug 26 15:01:10 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:01:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:11 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Deleted allocations for instance 4a45b34c-d927-4a7e-b71a-fa665269cdc0
Aug 26 15:01:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce318fd6-407f-4043-93c8-24195fe04805 tempest-TestServerVolumeAttachmentScenario-951083829 tempest-TestServerVolumeAttachmentScenario-951083829-project-member] Lock "4a45b34c-d927-4a7e-b71a-fa665269cdc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:11 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:01:12 user nova-compute[73052]: INFO nova.compute.claims [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Claim successful on node user
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:01:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:01:12 user nova-compute[73052]: INFO nova.virt.block_device [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Booting with volume edc0155b-369c-4c7b-9480-f11c829e00f9 at /dev/vda
Aug 26 15:01:12 user nova-compute[73052]: DEBUG nova.policy [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5061033588974e7ead6c7abc8a47308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3fc9a170804f0ebfa2dde967e3fec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG os_brick.utils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5ed133-23af-40ea-933c-01e9f542565a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caf8191-1768-4411-8a11-316383ef3781]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ac86f-cbe9-465c-8818-e98b33331899]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd06a6c-e8de-4ef4-b72c-6c96827373f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:01:13 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:01:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae15bbd-6032-4178-8a07-7392e868a85a]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG os_brick.utils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating existing volume attachment record: 921e495b-8ef5-44c5-8876-6edcba46b4d5 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:01:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Successfully created port: 3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Successfully updated port: 3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquired lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-e8a56cdf-2360-4f76-a85b-873609a961a1 req-8929c6ea-a721-4330-b534-40cbbccbafbc service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-changed-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-e8a56cdf-2360-4f76-a85b-873609a961a1 req-8929c6ea-a721-4330-b534-40cbbccbafbc service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Refreshing instance network info cache due to event network-changed-3d5216f0-f889-4824-b93f-2bccee3eba4d. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e8a56cdf-2360-4f76-a85b-873609a961a1 req-8929c6ea-a721-4330-b534-40cbbccbafbc service nova] Acquiring lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating instance_info_cache with network_info: [{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Releasing lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance network_info: |[{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e8a56cdf-2360-4f76-a85b-873609a961a1 req-8929c6ea-a721-4330-b534-40cbbccbafbc service nova] Acquired lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:01:14 user nova-compute[73052]: DEBUG nova.network.neutron [req-e8a56cdf-2360-4f76-a85b-873609a961a1 req-8929c6ea-a721-4330-b534-40cbbccbafbc service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Refreshing network info cache for port 3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:01:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-e8a56cdf-2360-4f76-a85b-873609a961a1 req-8929c6ea-a721-4330-b534-40cbbccbafbc service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updated VIF entry in instance network info cache for port 3d5216f0-f889-4824-b93f-2bccee3eba4d. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:01:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-e8a56cdf-2360-4f76-a85b-873609a961a1 req-8929c6ea-a721-4330-b534-40cbbccbafbc service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating instance_info_cache with network_info: [{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:01:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e8a56cdf-2360-4f76-a85b-873609a961a1 req-8929c6ea-a721-4330-b534-40cbbccbafbc service nova] Releasing lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:01:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:16 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:01:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:01:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:01:19 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:01:19 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7815MB free_disk=25.042213439941406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 27d11424-e15f-4561-84d0-82827ac35efd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:01:19 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:01:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:01:20 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:01:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:01:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:01:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:01:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062069.0819507, 4a45b34c-d927-4a7e-b71a-fa665269cdc0 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:01:24 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] VM Stopped (Lifecycle Event)
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-94ecd3e6-b94d-4f09-83db-75f331017133 None None] [instance: 4a45b34c-d927-4a7e-b71a-fa665269cdc0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:01:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Creating image(s)
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Ensure instance console log exists: /opt/stack/data/nova/instances/e1161d8d-aa8a-4eff-888e-c7b699a2b76f/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Start _get_guest_xml network_info=[{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '921e495b-8ef5-44c5-8876-6edcba46b4d5', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okOuSIjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1161d8d-aa8a-4eff-888e-c7b699a2b76f', 'attached_at': '', 'detached_at': '', 'volume_id': 'edc0155b-369c-4c7b-9480-f11c829e00f9', 'serial': 'edc0155b-369c-4c7b-9480-f11c829e00f9'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:01:24 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:01:24 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okOuSIjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:01:24 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:01:24 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:01:24 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d2960b-7208-4603-849f-74b8edabe437]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:01:24 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[238c0208-6734-4fb4-bcdb-c837efe5c1c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9] added
Aug 26 15:01:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[34827e7c-0604-4538-9f55-19bb463db746]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c486232e-0eae-4b13-901a-761840f7bf1b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okOuSIjL {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okOuSIjL" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a56960-e2bb-4c01-b8e7-5f04ec75ad59]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'okOuSIjL'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7705f5-8619-4d49-86cb-7e11cb1263bc]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[138dbda7-f77e-4932-92e4-f604705eec55]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:01:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:01:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274ae89-f643-4be8-b9a2-4f002172f076]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260]
Aug 26 15:01:24 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260] successful.
Aug 26 15:01:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416e96e-709a-4e3c-bbef-d087fce125a6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e1b17c-b924-4f3b-9225-3284a66ced23]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:01:24 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:01:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fd297f-9ddd-4f4e-8ab9-b258141c3d4f]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:01:24 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okOuSIjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23765396465626464', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765396465626464', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-767395342',display_name='tempest-ServerActionsTestOtherA-server-767395342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-767395342',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-t3a4pj50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=e1161d8d-aa8a-4eff-888e-c7b699a2b76f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.objects.instance [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'pci_devices' on Instance uuid e1161d8d-aa8a-4eff-888e-c7b699a2b76f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:01:25 user nova-compute[73052]:   <uuid>e1161d8d-aa8a-4eff-888e-c7b699a2b76f</uuid>
Aug 26 15:01:25 user nova-compute[73052]:   <name>instance-0000002a</name>
Aug 26 15:01:25 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:01:25 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:01:25 user nova-compute[73052]:   <metadata>
Aug 26 15:01:25 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:01:25 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:01:25 user nova-compute[73052]:       <nova:name>tempest-ServerActionsTestOtherA-server-767395342</nova:name>
Aug 26 15:01:25 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:01:24</nova:creationTime>
Aug 26 15:01:25 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:01:25 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:01:25 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:01:25 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:01:25 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:01:25 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:01:25 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:01:25 user nova-compute[73052]:       <nova:owner>
Aug 26 15:01:25 user nova-compute[73052]:         <nova:user uuid="5061033588974e7ead6c7abc8a47308e">tempest-ServerActionsTestOtherA-1682869035-project-member</nova:user>
Aug 26 15:01:25 user nova-compute[73052]:         <nova:project uuid="eb3fc9a170804f0ebfa2dde967e3fec2">tempest-ServerActionsTestOtherA-1682869035</nova:project>
Aug 26 15:01:25 user nova-compute[73052]:       </nova:owner>
Aug 26 15:01:25 user nova-compute[73052]:       <nova:ports>
Aug 26 15:01:25 user nova-compute[73052]:         <nova:port uuid="3d5216f0-f889-4824-b93f-2bccee3eba4d">
Aug 26 15:01:25 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 15:01:25 user nova-compute[73052]:         </nova:port>
Aug 26 15:01:25 user nova-compute[73052]:       </nova:ports>
Aug 26 15:01:25 user nova-compute[73052]:     </nova:instance>
Aug 26 15:01:25 user nova-compute[73052]:   </metadata>
Aug 26 15:01:25 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:01:25 user nova-compute[73052]:     <system>
Aug 26 15:01:25 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:01:25 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:01:25 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:01:25 user nova-compute[73052]:       <entry name="serial">e1161d8d-aa8a-4eff-888e-c7b699a2b76f</entry>
Aug 26 15:01:25 user nova-compute[73052]:       <entry name="uuid">e1161d8d-aa8a-4eff-888e-c7b699a2b76f</entry>
Aug 26 15:01:25 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:01:25 user nova-compute[73052]:     </system>
Aug 26 15:01:25 user nova-compute[73052]:   </sysinfo>
Aug 26 15:01:25 user nova-compute[73052]:   <os>
Aug 26 15:01:25 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:01:25 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:01:25 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:01:25 user nova-compute[73052]:   </os>
Aug 26 15:01:25 user nova-compute[73052]:   <features>
Aug 26 15:01:25 user nova-compute[73052]:     <acpi/>
Aug 26 15:01:25 user nova-compute[73052]:     <apic/>
Aug 26 15:01:25 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:01:25 user nova-compute[73052]:   </features>
Aug 26 15:01:25 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:01:25 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:01:25 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:01:25 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:01:25 user nova-compute[73052]:   </clock>
Aug 26 15:01:25 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:01:25 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:01:25 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:01:25 user nova-compute[73052]:   </cpu>
Aug 26 15:01:25 user nova-compute[73052]:   <devices>
Aug 26 15:01:25 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:01:25 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:01:25 user nova-compute[73052]:       <source dev="/dev/sde"/>
Aug 26 15:01:25 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:01:25 user nova-compute[73052]:       <serial>edc0155b-369c-4c7b-9480-f11c829e00f9</serial>
Aug 26 15:01:25 user nova-compute[73052]:     </disk>
Aug 26 15:01:25 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:01:25 user nova-compute[73052]:       <mac address="fa:16:3e:ba:bf:ca"/>
Aug 26 15:01:25 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:01:25 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:01:25 user nova-compute[73052]:       <target dev="tap3d5216f0-f8"/>
Aug 26 15:01:25 user nova-compute[73052]:     </interface>
Aug 26 15:01:25 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:01:25 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/e1161d8d-aa8a-4eff-888e-c7b699a2b76f/console.log" append="off"/>
Aug 26 15:01:25 user nova-compute[73052]:     </serial>
Aug 26 15:01:25 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:01:25 user nova-compute[73052]:     <video>
Aug 26 15:01:25 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:01:25 user nova-compute[73052]:     </video>
Aug 26 15:01:25 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:01:25 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:01:25 user nova-compute[73052]:     </rng>
Aug 26 15:01:25 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:01:25 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:01:25 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:01:25 user nova-compute[73052]:     </memballoon>
Aug 26 15:01:25 user nova-compute[73052]:   </devices>
Aug 26 15:01:25 user nova-compute[73052]: </domain>
Aug 26 15:01:25 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-767395342',display_name='tempest-ServerActionsTestOtherA-server-767395342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-767395342',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-t3a4pj50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=e1161d8d-aa8a-4eff-888e-c7b699a2b76f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG os_vif [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d5216f0-f8, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d5216f0-f8, col_values=(('external_ids', {'iface-id': '3d5216f0-f889-4824-b93f-2bccee3eba4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:bf:ca', 'vm-uuid': 'e1161d8d-aa8a-4eff-888e-c7b699a2b76f'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:25 user nova-compute[73052]: INFO os_vif [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8')
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:01:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No VIF found with MAC fa:16:3e:ba:bf:ca, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG nova.compute.manager [req-a6807df5-c862-4bc5-9c4e-7eb25ef4785c req-b14c3ccb-4f06-4f12-9c1c-291fd11034ef service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a6807df5-c862-4bc5-9c4e-7eb25ef4785c req-b14c3ccb-4f06-4f12-9c1c-291fd11034ef service nova] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a6807df5-c862-4bc5-9c4e-7eb25ef4785c req-b14c3ccb-4f06-4f12-9c1c-291fd11034ef service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a6807df5-c862-4bc5-9c4e-7eb25ef4785c req-b14c3ccb-4f06-4f12-9c1c-291fd11034ef service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG nova.compute.manager [req-a6807df5-c862-4bc5-9c4e-7eb25ef4785c req-b14c3ccb-4f06-4f12-9c1c-291fd11034ef service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] No waiting events found dispatching network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:01:27 user nova-compute[73052]: WARNING nova.compute.manager [req-a6807df5-c862-4bc5-9c4e-7eb25ef4785c req-b14c3ccb-4f06-4f12-9c1c-291fd11034ef service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received unexpected event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d for instance with vm_state building and task_state spawning.
Aug 26 15:01:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062089.0991924, e1161d8d-aa8a-4eff-888e-c7b699a2b76f => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:01:29 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] VM Resumed (Lifecycle Event)
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:01:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance spawned successfully.
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:01:29 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062089.100482, e1161d8d-aa8a-4eff-888e-c7b699a2b76f => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:01:29 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] VM Started (Lifecycle Event)
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:01:29 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:01:29 user nova-compute[73052]: INFO nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:01:29 user nova-compute[73052]: INFO nova.compute.manager [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Took 16.92 seconds to build instance.
Aug 26 15:01:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8856fe72-8a45-44ce-bf0c-5c1814e248be tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.039s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-0c826cf7-fc9f-4ac9-a405-56adb88e42fa req-aacd73c4-f4de-424f-86e3-4788365437d9 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0c826cf7-fc9f-4ac9-a405-56adb88e42fa req-aacd73c4-f4de-424f-86e3-4788365437d9 service nova] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0c826cf7-fc9f-4ac9-a405-56adb88e42fa req-aacd73c4-f4de-424f-86e3-4788365437d9 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0c826cf7-fc9f-4ac9-a405-56adb88e42fa req-aacd73c4-f4de-424f-86e3-4788365437d9 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-0c826cf7-fc9f-4ac9-a405-56adb88e42fa req-aacd73c4-f4de-424f-86e3-4788365437d9 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] No waiting events found dispatching network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:01:29 user nova-compute[73052]: WARNING nova.compute.manager [req-0c826cf7-fc9f-4ac9-a405-56adb88e42fa req-aacd73c4-f4de-424f-86e3-4788365437d9 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received unexpected event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d for instance with vm_state active and task_state None.
Aug 26 15:01:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:01:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:01:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:01:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG nova.compute.manager [req-9ef0c2b0-5964-4261-81e4-87063c0c680a req-0410f1c8-22e4-4ecf-b1fe-dcd967cff710 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received event network-changed-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG nova.compute.manager [req-9ef0c2b0-5964-4261-81e4-87063c0c680a req-0410f1c8-22e4-4ecf-b1fe-dcd967cff710 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Refreshing instance network info cache due to event network-changed-f2f6d721-3205-487b-9d64-73be2b946d5d. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9ef0c2b0-5964-4261-81e4-87063c0c680a req-0410f1c8-22e4-4ecf-b1fe-dcd967cff710 service nova] Acquiring lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9ef0c2b0-5964-4261-81e4-87063c0c680a req-0410f1c8-22e4-4ecf-b1fe-dcd967cff710 service nova] Acquired lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG nova.network.neutron [req-9ef0c2b0-5964-4261-81e4-87063c0c680a req-0410f1c8-22e4-4ecf-b1fe-dcd967cff710 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Refreshing network info cache for port f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG nova.objects.instance [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'flavor' on Instance uuid 8a75e8d1-668a-4014-a476-a2e3730f01a8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:04 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Ignoring supplied device name: /dev/vdb
Aug 26 15:02:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:04 user nova-compute[73052]: INFO nova.compute.manager [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Attaching volume 4b072b40-22d7-4b1e-88ac-5cc49b0d8faf to /dev/vdb
Aug 26 15:02:04 user nova-compute[73052]: DEBUG os_brick.utils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:04 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG nova.network.neutron [req-9ef0c2b0-5964-4261-81e4-87063c0c680a req-0410f1c8-22e4-4ecf-b1fe-dcd967cff710 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Updated VIF entry in instance network info cache for port f2f6d721-3205-487b-9d64-73be2b946d5d. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG nova.network.neutron [req-9ef0c2b0-5964-4261-81e4-87063c0c680a req-0410f1c8-22e4-4ecf-b1fe-dcd967cff710 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Updating instance_info_cache with network_info: [{"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7924fe1f-2ca4-46c9-a72a-cd7136c71823]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9ef0c2b0-5964-4261-81e4-87063c0c680a req-0410f1c8-22e4-4ecf-b1fe-dcd967cff710 service nova] Releasing lock "refresh_cache-8a75e8d1-668a-4014-a476-a2e3730f01a8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4fb89d-8eae-4263-8944-b5201170b3df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a1142-5891-4ba6-ad43-3010ce4b2237]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ff56e7-0109-4834-913d-196b84738fe9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:02:05 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:02:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e3169f-dcaf-4bba-8e15-e045bd71f6bd]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG os_brick.utils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Updating existing volume attachment record: 6f531aaa-1102-4218-9152-559798ee46f9 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:02:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:09 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:02:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:02:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:02:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:02:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:02:09 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 33ec579e-3ce9-46e3-9e06-ca91fb20571f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:02:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:02:10 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:02:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:12 user nova-compute[73052]: DEBUG nova.compute.manager [req-139bc986-9080-41dd-93f2-7ff664eb9496 req-622f3d06-f4bc-4831-a59d-35e32dadc851 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-changed-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:12 user nova-compute[73052]: DEBUG nova.compute.manager [req-139bc986-9080-41dd-93f2-7ff664eb9496 req-622f3d06-f4bc-4831-a59d-35e32dadc851 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Refreshing instance network info cache due to event network-changed-255a6abb-2603-4ac3-87cb-e7c030792899. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:02:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-139bc986-9080-41dd-93f2-7ff664eb9496 req-622f3d06-f4bc-4831-a59d-35e32dadc851 service nova] Acquiring lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:02:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-139bc986-9080-41dd-93f2-7ff664eb9496 req-622f3d06-f4bc-4831-a59d-35e32dadc851 service nova] Acquired lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:02:12 user nova-compute[73052]: DEBUG nova.network.neutron [req-139bc986-9080-41dd-93f2-7ff664eb9496 req-622f3d06-f4bc-4831-a59d-35e32dadc851 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Refreshing network info cache for port 255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:02:13 user nova-compute[73052]: DEBUG nova.network.neutron [req-139bc986-9080-41dd-93f2-7ff664eb9496 req-622f3d06-f4bc-4831-a59d-35e32dadc851 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updated VIF entry in instance network info cache for port 255a6abb-2603-4ac3-87cb-e7c030792899. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:02:13 user nova-compute[73052]: DEBUG nova.network.neutron [req-139bc986-9080-41dd-93f2-7ff664eb9496 req-622f3d06-f4bc-4831-a59d-35e32dadc851 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updating instance_info_cache with network_info: [{"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:02:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-139bc986-9080-41dd-93f2-7ff664eb9496 req-622f3d06-f4bc-4831-a59d-35e32dadc851 service nova] Releasing lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:02:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtiSPhQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:16 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[37be2f09-12c8-420a-bbf0-5332a6a003c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:02:16 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb0ee7-8c8f-4e7a-b860-31b89b2d486e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf] added
Aug 26 15:02:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0facf3d8-91ae-4f68-ab20-6cbc360657d5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb71ab21-afe1-4df7-8472-d0b8a5eed735]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtiSPhQZ {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtiSPhQZ" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08b2804-c84a-486b-b9d3-67c95d84bc07]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wtiSPhQZ'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[61616012-0f31-4a25-873f-a48c792bd54d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dcf3c2-6e73-41a0-a26e-92c8643a77cc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:16 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:16 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:16 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:16 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:16 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:16 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adac63b-1fa6-46cf-8522-f04cece72423]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf, portal: 172.16.0.220,3260]
Aug 26 15:02:17 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf, portal: 172.16.0.220,3260] successful.
Aug 26 15:02:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e742bb6-eef9-4264-b8da-3528626be9ed]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e020106d-16b3-4039-a60b-e15e385fea92]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:17 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:17 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:17 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:17 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:17 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:17 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:17 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:17 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:17 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[071f1f27-1e5a-4b99-8ab1-82e2754103bd]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:02:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtiSPhQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23830336434613765', 'path': '/dev/sdf'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830336434613765', 'path': '/dev/sdf'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG nova.objects.instance [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'flavor' on Instance uuid 8a75e8d1-668a-4014-a476-a2e3730f01a8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:02:18 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:02:18 user nova-compute[73052]:   <source dev="/dev/sdf"/>
Aug 26 15:02:18 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:02:18 user nova-compute[73052]:   <serial>4b072b40-22d7-4b1e-88ac-5cc49b0d8faf</serial>
Aug 26 15:02:18 user nova-compute[73052]: </disk>
Aug 26 15:02:18 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] No VIF found with MAC fa:16:3e:2f:5a:2e, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-868ffaf4-e3d4-4745-9844-1dd3e2e2c356 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.835s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:02:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:02:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:02:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:02:21 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:02:21 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:02:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7771MB free_disk=25.039573669433594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:02:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 27d11424-e15f-4561-84d0-82827ac35efd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:02:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:02:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:02:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-81e28eba-ecc0-4b62-aef9-dbd1e17ef93b req-8e555f07-b690-45b8-ac10-068c50a64505 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-changed-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-81e28eba-ecc0-4b62-aef9-dbd1e17ef93b req-8e555f07-b690-45b8-ac10-068c50a64505 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Refreshing instance network info cache due to event network-changed-60cc7257-0309-4a6a-acc5-4af2cb1afc86. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:02:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81e28eba-ecc0-4b62-aef9-dbd1e17ef93b req-8e555f07-b690-45b8-ac10-068c50a64505 service nova] Acquiring lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:02:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81e28eba-ecc0-4b62-aef9-dbd1e17ef93b req-8e555f07-b690-45b8-ac10-068c50a64505 service nova] Acquired lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:02:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-81e28eba-ecc0-4b62-aef9-dbd1e17ef93b req-8e555f07-b690-45b8-ac10-068c50a64505 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Refreshing network info cache for port 60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-81e28eba-ecc0-4b62-aef9-dbd1e17ef93b req-8e555f07-b690-45b8-ac10-068c50a64505 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updated VIF entry in instance network info cache for port 60cc7257-0309-4a6a-acc5-4af2cb1afc86. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-81e28eba-ecc0-4b62-aef9-dbd1e17ef93b req-8e555f07-b690-45b8-ac10-068c50a64505 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updating instance_info_cache with network_info: [{"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "f15dddfa-46f0-44d7-92cd-d6191d722670" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81e28eba-ecc0-4b62-aef9-dbd1e17ef93b req-8e555f07-b690-45b8-ac10-068c50a64505 service nova] Releasing lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:02:29 user nova-compute[73052]: INFO nova.compute.claims [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Claim successful on node user
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'flavor' on Instance uuid 27d11424-e15f-4561-84d0-82827ac35efd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:29 user nova-compute[73052]: INFO nova.compute.manager [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Attaching volume 39f97208-2fe6-4944-9bf7-2380662e34d0 to /dev/vdb
Aug 26 15:02:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea4f840-cdd6-42c3-acb3-a328d374b04a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0513403e-57d0-4f57-9416-4778aac1b07a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[746d21dd-b4dc-4b57-bbd6-a6bb9489b232]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99752de-c67e-44e2-baed-5e6d416eb6b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:02:29 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb23d7c-f652-4bd4-9bef-53f24a31203e]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updating existing volume attachment record: a2d5370e-412d-43f4-ac05-478ddd419a9d {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:02:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:02:29 user nova-compute[73052]: INFO nova.virt.block_device [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Booting with volume 310aaf44-72dc-44c6-b7eb-df6a07ae3084 at /dev/vda
Aug 26 15:02:29 user nova-compute[73052]: DEBUG nova.policy [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce6cd78a2f7c407983d90a15ffb94967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8ab154558a4521920e05921722db36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cb6de8-8387-448b-b91e-4cd9005aae28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c7d2ff-0b72-419a-ac6c-672a6c3aa221]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b0d30b-7588-46f1-be7e-6941594077eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31673de-034c-47f5-ab95-b32e594a0fa2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:02:30 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:02:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b31d24-f4aa-4bc5-a989-9af33d6b68ae]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG os_brick.utils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updating existing volume attachment record: aac86655-5bee-4dd0-97ca-9e80c4699220 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Successfully created port: ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:02:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Successfully updated port: ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:02:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:02:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquired lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:02:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:02:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:02:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-90a86bbb-0474-4bef-84e5-f44f9d43dcb3 req-8c599ec7-9a4f-482c-94e5-81876da67ac4 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-changed-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-90a86bbb-0474-4bef-84e5-f44f9d43dcb3 req-8c599ec7-9a4f-482c-94e5-81876da67ac4 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Refreshing instance network info cache due to event network-changed-ca69b639-25df-404d-9907-6e2a17d556c9. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:02:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-90a86bbb-0474-4bef-84e5-f44f9d43dcb3 req-8c599ec7-9a4f-482c-94e5-81876da67ac4 service nova] Acquiring lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:02:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updating instance_info_cache with network_info: [{"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:02:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Releasing lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:02:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Instance network_info: |[{"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:02:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-90a86bbb-0474-4bef-84e5-f44f9d43dcb3 req-8c599ec7-9a4f-482c-94e5-81876da67ac4 service nova] Acquired lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:02:32 user nova-compute[73052]: DEBUG nova.network.neutron [req-90a86bbb-0474-4bef-84e5-f44f9d43dcb3 req-8c599ec7-9a4f-482c-94e5-81876da67ac4 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Refreshing network info cache for port ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:02:32 user nova-compute[73052]: DEBUG nova.network.neutron [req-90a86bbb-0474-4bef-84e5-f44f9d43dcb3 req-8c599ec7-9a4f-482c-94e5-81876da67ac4 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updated VIF entry in instance network info cache for port ca69b639-25df-404d-9907-6e2a17d556c9. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:02:32 user nova-compute[73052]: DEBUG nova.network.neutron [req-90a86bbb-0474-4bef-84e5-f44f9d43dcb3 req-8c599ec7-9a4f-482c-94e5-81876da67ac4 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updating instance_info_cache with network_info: [{"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:02:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-90a86bbb-0474-4bef-84e5-f44f9d43dcb3 req-8c599ec7-9a4f-482c-94e5-81876da67ac4 service nova] Releasing lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:02:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:36 user nova-compute[73052]: INFO nova.compute.manager [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Rescuing
Aug 26 15:02:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:02:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquired lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:02:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG nova.network.neutron [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating instance_info_cache with network_info: [{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Releasing lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-2b0e5d7c-0c4a-444d-82cc-52f36d96402c req-fe965d5a-6932-43d3-951f-5569b49dd2db service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2b0e5d7c-0c4a-444d-82cc-52f36d96402c req-fe965d5a-6932-43d3-951f-5569b49dd2db service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2b0e5d7c-0c4a-444d-82cc-52f36d96402c req-fe965d5a-6932-43d3-951f-5569b49dd2db service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2b0e5d7c-0c4a-444d-82cc-52f36d96402c req-fe965d5a-6932-43d3-951f-5569b49dd2db service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-2b0e5d7c-0c4a-444d-82cc-52f36d96402c req-fe965d5a-6932-43d3-951f-5569b49dd2db service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:02:37 user nova-compute[73052]: WARNING nova.compute.manager [req-2b0e5d7c-0c4a-444d-82cc-52f36d96402c req-fe965d5a-6932-43d3-951f-5569b49dd2db service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state active and task_state rescuing.
Aug 26 15:02:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:37 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance destroyed successfully.
Aug 26 15:02:37 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Attempting a stable device rescue
Aug 26 15:02:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73052) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance directory exists: not creating {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 15:02:37 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Creating image(s)
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "/opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "/opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "/opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "12dd48af2610761a05b8e6df0f59b36fc33fa5ce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "12dd48af2610761a05b8e6df0f59b36fc33fa5ce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce.part --force-share --output=json" returned: 0 in 0.218s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG nova.virt.images [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] d7e7ee25-280e-449d-af46-a32c0b1c233f was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce.part /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-5da09f7f-a288-4b6a-9c02-28df61db1499 req-22a3f880-7bc5-4a44-8302-41b9e3d943b6 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5da09f7f-a288-4b6a-9c02-28df61db1499 req-22a3f880-7bc5-4a44-8302-41b9e3d943b6 service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5da09f7f-a288-4b6a-9c02-28df61db1499 req-22a3f880-7bc5-4a44-8302-41b9e3d943b6 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5da09f7f-a288-4b6a-9c02-28df61db1499 req-22a3f880-7bc5-4a44-8302-41b9e3d943b6 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-5da09f7f-a288-4b6a-9c02-28df61db1499 req-22a3f880-7bc5-4a44-8302-41b9e3d943b6 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:02:39 user nova-compute[73052]: WARNING nova.compute.manager [req-5da09f7f-a288-4b6a-9c02-28df61db1499 req-22a3f880-7bc5-4a44-8302-41b9e3d943b6 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state active and task_state rescuing.
Aug 26 15:02:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce.part /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce.converted" returned: 0 in 0.540s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "12dd48af2610761a05b8e6df0f59b36fc33fa5ce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.052s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "12dd48af2610761a05b8e6df0f59b36fc33fa5ce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "12dd48af2610761a05b8e6df0f59b36fc33fa5ce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce,backing_fmt=raw /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce,backing_fmt=raw /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue" returned: 0 in 0.050s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "12dd48af2610761a05b8e6df0f59b36fc33fa5ce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'migration_context' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<8089746e-24d8-4792-a97b-62193a2ad808> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Start _get_guest_xml network_info=[{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "vif_mac": "fa:16:3e:e8:80:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd7e7ee25-280e-449d-af46-a32c0b1c233f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '897df1a1-8d7e-496a-b81c-f2762dffad97', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmYWiRxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8089746e-24d8-4792-a97b-62193a2ad808', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6d9c6c3-f7b6-4889-87db-24b32d362c2b', 'serial': 'c6d9c6c3-f7b6-4889-87db-24b32d362c2b'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'resources' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<8089746e-24d8-4792-a97b-62193a2ad808> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'numa_topology' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<8089746e-24d8-4792-a97b-62193a2ad808> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:02:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<8089746e-24d8-4792-a97b-62193a2ad808> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmYWiRxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:40 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:40 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:40 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb1d9e1-4b1c-4c2a-924f-38705d95170d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QmYWiRxt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 15:02:40 user nova-compute[73052]: node.name = iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b
Aug 26 15:02:40 user nova-compute[73052]: node.tpgt = -1
Aug 26 15:02:40 user nova-compute[73052]: node.startup = automatic
Aug 26 15:02:40 user nova-compute[73052]: node.leading_login = No
Aug 26 15:02:40 user nova-compute[73052]: iface.iscsi_ifacename = default
Aug 26 15:02:40 user nova-compute[73052]: iface.net_ifacename = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.ipaddress = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.prefix_len = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.hwaddress = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.transport_name = tcp
Aug 26 15:02:40 user nova-compute[73052]: iface.initiatorname = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.state = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.vlan_id = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.vlan_priority = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.vlan_state = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.iface_num = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.mtu = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.port = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.bootproto = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.subnet_mask = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.gateway = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.dhcp_alt_client_id = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.dhcp_dns = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.dhcp_learn_iqn = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.dhcp_vendor_id_state = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.dhcp_vendor_id = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.dhcp_slp_da = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.fragmentation = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.gratuitous_arp = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.incoming_forwarding = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.tos_state = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.tos = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.ttl = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.delayed_ack = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.tcp_nagle = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.tcp_wsf_state = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.tcp_wsf = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.tcp_timer_scale = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.tcp_timestamp = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.redirect = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.def_task_mgmt_timeout = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.header_digest = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.data_digest = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.immediate_data = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.initial_r2t = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.data_seq_inorder = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.data_pdu_inorder = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.erl = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.max_receive_data_len = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.first_burst_len = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.max_outstanding_r2t = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.max_burst_len = 0
Aug 26 15:02:40 user nova-compute[73052]: iface.chap_auth = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.bidi_chap = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.strict_login_compliance = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.discovery_auth = <empty>
Aug 26 15:02:40 user nova-compute[73052]: iface.discovery_logout = <empty>
Aug 26 15:02:40 user nova-compute[73052]: node.discovery_address = <empty>
Aug 26 15:02:40 user nova-compute[73052]: node.discovery_port = 0
Aug 26 15:02:40 user nova-compute[73052]: node.discovery_type = static
Aug 26 15:02:40 user nova-compute[73052]: node.session.initial_cmdsn = 0
Aug 26 15:02:40 user nova-compute[73052]: node.session.initial_login_retry_max = 8
Aug 26 15:02:40 user nova-compute[73052]: node.session.xmit_thread_priority = -20
Aug 26 15:02:40 user nova-compute[73052]: node.session.cmds_max = 128
Aug 26 15:02:40 user nova-compute[73052]: node.session.queue_depth = 32
Aug 26 15:02:40 user nova-compute[73052]: node.session.nr_sessions = 1
Aug 26 15:02:40 user nova-compute[73052]: node.session.auth.authmethod = CHAP
Aug 26 15:02:40 user nova-compute[73052]: node.session.auth.username = QmYWiRxt
Aug 26 15:02:40 user nova-compute[73052]: node.session.auth.password = ***
Aug 26 15:02:40 user nova-compute[73052]: node.session.auth.username_in = <empty>
Aug 26 15:02:40 user nova-compute[73052]: node.session.auth.password_in = <empty>
Aug 26 15:02:40 user nova-compute[73052]: node.session.auth.chap_algs = MD5
Aug 26 15:02:40 user nova-compute[73052]: node.session.timeo.replacement_timeout = 120
Aug 26 15:02:40 user nova-compute[73052]: node.session.err_timeo.abort_timeout = 15
Aug 26 15:02:40 user nova-compute[73052]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 15:02:40 user nova-compute[73052]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 15:02:40 user nova-compute[73052]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.FastAbort = Yes
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.InitialR2T = No
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.ImmediateData = Yes
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.MaxConnections = 1
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 15:02:40 user nova-compute[73052]: node.session.iscsi.ERL = 0
Aug 26 15:02:40 user nova-compute[73052]: node.session.scan = manual
Aug 26 15:02:40 user nova-compute[73052]: node.session.reopen_max = 0
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].address = 172.16.0.220
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].port = 3260
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].startup = manual
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].tcp.window_size = 524288
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].tcp.type_of_service = 0
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].timeo.logout_timeout = 15
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].timeo.login_timeout = 15
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].timeo.auth_timeout = 45
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].iscsi.DataDigest = None
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].iscsi.IFMarker = No
Aug 26 15:02:40 user nova-compute[73052]: node.conn[0].iscsi.OFMarker = No
Aug 26 15:02:40 user nova-compute[73052]: # END RECORD
Aug 26 15:02:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6212ced-dd73-4fe5-826d-1d0a0f951bca]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cdb9c7-af82-457b-a718-d5849228e2e7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmYWiRxt {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmYWiRxt" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92a41d2-9c7b-4976-a323-0e8c8b15fbea]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QmYWiRxt'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b84372-c3ef-487b-8a7d-0cd9b33b3d30]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f000d8-98a6-4e95-9aa4-169ec6ed99dd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:40 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:40 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:40 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:40 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:40 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:40 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:40 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:40 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] HCTL ('35', '0', '0', 0) found on session 47 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbd0ac5-0250-498d-aec9-6672b1f766ba]: (4, ('0 0 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching for a device in session 47 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmYWiRxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23138666537383639', 'path': '/dev/sdd'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138666537383639', 'path': '/dev/sdd'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1896647055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1896647055',id=41,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-ubl3jk5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:01:09Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=8089746e-24d8-4792-a97b-62193a2ad808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "vif_mac": "fa:16:3e:e8:80:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "vif_mac": "fa:16:3e:e8:80:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:80:11,bridge_name='br-int',has_traffic_filtering=True,id=96001862-3845-4236-8fb5-62a383e8141b,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96001862-38') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'pci_devices' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.objects.base [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<8089746e-24d8-4792-a97b-62193a2ad808> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:02:40 user nova-compute[73052]:   <uuid>8089746e-24d8-4792-a97b-62193a2ad808</uuid>
Aug 26 15:02:40 user nova-compute[73052]:   <name>instance-00000029</name>
Aug 26 15:02:40 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:02:40 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:02:40 user nova-compute[73052]:   <metadata>
Aug 26 15:02:40 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:02:40 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:02:40 user nova-compute[73052]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1896647055</nova:name>
Aug 26 15:02:40 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:02:40</nova:creationTime>
Aug 26 15:02:40 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:02:40 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:02:40 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:02:40 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:02:40 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:02:40 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:02:40 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:02:40 user nova-compute[73052]:       <nova:owner>
Aug 26 15:02:40 user nova-compute[73052]:         <nova:user uuid="57f5f67238404fb9954260ad90a0a96d">tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member</nova:user>
Aug 26 15:02:40 user nova-compute[73052]:         <nova:project uuid="fe7051da8614456b9334b146fa3581fd">tempest-ServerBootFromVolumeStableRescueTest-505611186</nova:project>
Aug 26 15:02:40 user nova-compute[73052]:       </nova:owner>
Aug 26 15:02:40 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:02:40 user nova-compute[73052]:       <nova:ports>
Aug 26 15:02:40 user nova-compute[73052]:         <nova:port uuid="96001862-3845-4236-8fb5-62a383e8141b">
Aug 26 15:02:40 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 15:02:40 user nova-compute[73052]:         </nova:port>
Aug 26 15:02:40 user nova-compute[73052]:       </nova:ports>
Aug 26 15:02:40 user nova-compute[73052]:     </nova:instance>
Aug 26 15:02:40 user nova-compute[73052]:   </metadata>
Aug 26 15:02:40 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:02:40 user nova-compute[73052]:     <system>
Aug 26 15:02:40 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:02:40 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:02:40 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:02:40 user nova-compute[73052]:       <entry name="serial">8089746e-24d8-4792-a97b-62193a2ad808</entry>
Aug 26 15:02:40 user nova-compute[73052]:       <entry name="uuid">8089746e-24d8-4792-a97b-62193a2ad808</entry>
Aug 26 15:02:40 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:02:40 user nova-compute[73052]:     </system>
Aug 26 15:02:40 user nova-compute[73052]:   </sysinfo>
Aug 26 15:02:40 user nova-compute[73052]:   <os>
Aug 26 15:02:40 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:02:40 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:02:40 user nova-compute[73052]:   </os>
Aug 26 15:02:40 user nova-compute[73052]:   <features>
Aug 26 15:02:40 user nova-compute[73052]:     <acpi/>
Aug 26 15:02:40 user nova-compute[73052]:     <apic/>
Aug 26 15:02:40 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:02:40 user nova-compute[73052]:   </features>
Aug 26 15:02:40 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:02:40 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:02:40 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:02:40 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:02:40 user nova-compute[73052]:   </clock>
Aug 26 15:02:40 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:02:40 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:02:40 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:02:40 user nova-compute[73052]:   </cpu>
Aug 26 15:02:40 user nova-compute[73052]:   <devices>
Aug 26 15:02:40 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:02:40 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:02:40 user nova-compute[73052]:       <source dev="/dev/sdd"/>
Aug 26 15:02:40 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:02:40 user nova-compute[73052]:       <serial>c6d9c6c3-f7b6-4889-87db-24b32d362c2b</serial>
Aug 26 15:02:40 user nova-compute[73052]:     </disk>
Aug 26 15:02:40 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:02:40 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:02:40 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue"/>
Aug 26 15:02:40 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 15:02:40 user nova-compute[73052]:       <boot order="1"/>
Aug 26 15:02:40 user nova-compute[73052]:     </disk>
Aug 26 15:02:40 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:02:40 user nova-compute[73052]:       <mac address="fa:16:3e:e8:80:11"/>
Aug 26 15:02:40 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:02:40 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:02:40 user nova-compute[73052]:       <target dev="tap96001862-38"/>
Aug 26 15:02:40 user nova-compute[73052]:     </interface>
Aug 26 15:02:40 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:02:40 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/console.log" append="off"/>
Aug 26 15:02:40 user nova-compute[73052]:     </serial>
Aug 26 15:02:40 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:02:40 user nova-compute[73052]:     <video>
Aug 26 15:02:40 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:02:40 user nova-compute[73052]:     </video>
Aug 26 15:02:40 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:02:40 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:02:40 user nova-compute[73052]:     </rng>
Aug 26 15:02:40 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:02:40 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:02:40 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:02:40 user nova-compute[73052]:     </memballoon>
Aug 26 15:02:40 user nova-compute[73052]:   </devices>
Aug 26 15:02:40 user nova-compute[73052]: </domain>
Aug 26 15:02:40 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:02:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance destroyed successfully.
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No VIF found with MAC fa:16:3e:e8:80:11, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:02:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNRaJefh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:41 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:41 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:41 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:02:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[14df71c1-786c-448a-97b8-aa4ab287ca00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:02:41 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b0b742-41f3-4d94-b8fb-acbffaaf8183]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0] added
Aug 26 15:02:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a30f7d-8e49-44ec-8793-a984c3966828]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbf770c-585f-4ba1-8c90-9c94cae226bf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNRaJefh {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNRaJefh" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf27bf54-e5be-4df9-b184-426ac9da247e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MNRaJefh'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb0f336-3091-4f15-b4a3-0cb802593e9e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80dfa47-169f-41cc-bc69-8e7fdfcc275d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e7201-cc81-4278-8944-f761b64f0ad8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0, portal: 172.16.0.220,3260]
Aug 26 15:02:42 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0, portal: 172.16.0.220,3260] successful.
Aug 26 15:02:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b8468e-5049-4a88-b4d3-45546c541b96]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[24aa85fa-66eb-4b02-b18d-80097e24e85b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:42 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:42 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] HCTL ('38', '-', '-', 0) found on session 50 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-ae3838be-c683-485d-a97f-9c460ca20770 req-f9f6dbf0-b665-4729-b1e8-ac3da43aa284 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ae3838be-c683-485d-a97f-9c460ca20770 req-f9f6dbf0-b665-4729-b1e8-ac3da43aa284 service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ae3838be-c683-485d-a97f-9c460ca20770 req-f9f6dbf0-b665-4729-b1e8-ac3da43aa284 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ae3838be-c683-485d-a97f-9c460ca20770 req-f9f6dbf0-b665-4729-b1e8-ac3da43aa284 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-ae3838be-c683-485d-a97f-9c460ca20770 req-f9f6dbf0-b665-4729-b1e8-ac3da43aa284 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:02:42 user nova-compute[73052]: WARNING nova.compute.manager [req-ae3838be-c683-485d-a97f-9c460ca20770 req-f9f6dbf0-b665-4729-b1e8-ac3da43aa284 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state active and task_state rescuing.
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.042s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87063b6-a7a2-407b-942a-d76993aa40a7]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Searching for a device in session 50 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNRaJefh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23533393239306364', 'path': '/dev/sdg'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533393239306364', 'path': '/dev/sdg'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'flavor' on Instance uuid 27d11424-e15f-4561-84d0-82827ac35efd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:02:43 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:02:43 user nova-compute[73052]:   <source dev="/dev/sdg"/>
Aug 26 15:02:43 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:02:43 user nova-compute[73052]:   <serial>39f97208-2fe6-4944-9bf7-2380662e34d0</serial>
Aug 26 15:02:43 user nova-compute[73052]: </disk>
Aug 26 15:02:43 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquired lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'info_cache' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.objects.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] No VIF found with MAC fa:16:3e:14:cc:48, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:02:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d1c07342-0052-4129-bce3-1a687cd29033 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.489s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.network.neutron [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updating instance_info_cache with network_info: [{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Releasing lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:02:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance destroyed successfully.
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'resources' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.objects.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_vif [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a404e9c-e1, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:02:44 user nova-compute[73052]: INFO os_vif [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1')
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVBnAPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for 8089746e-24d8-4792-a97b-62193a2ad808 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062164.2872558, 8089746e-24d8-4792-a97b-62193a2ad808 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:02:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] VM Resumed (Lifecycle Event)
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ce06e074-77a0-48b5-8cbc-2ec7ce8cd2f8 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb3d5b-406e-4463-8d1f-b05c45d7dcf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0947a822-2b62-4e3c-8d18-502884725ac8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c6ccd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062164.288713, 8089746e-24d8-4792-a97b-62193a2ad808 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:02:44 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] VM Started (Lifecycle Event)
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb41efcd-39fb-48b1-8b6a-17f35bf7118a req-b75f456c-8558-4e08-aacd-a3fb79705e67 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb41efcd-39fb-48b1-8b6a-17f35bf7118a req-b75f456c-8558-4e08-aacd-a3fb79705e67 service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb41efcd-39fb-48b1-8b6a-17f35bf7118a req-b75f456c-8558-4e08-aacd-a3fb79705e67 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-bb41efcd-39fb-48b1-8b6a-17f35bf7118a req-b75f456c-8558-4e08-aacd-a3fb79705e67 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-bb41efcd-39fb-48b1-8b6a-17f35bf7118a req-b75f456c-8558-4e08-aacd-a3fb79705e67 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:02:44 user nova-compute[73052]: WARNING nova.compute.manager [req-bb41efcd-39fb-48b1-8b6a-17f35bf7118a req-b75f456c-8558-4e08-aacd-a3fb79705e67 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state active and task_state rescuing.
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1d88a4-a55d-4aa9-a2c7-561eb9a15137]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b935ee5c-8d77-479a-8012-5a6e95e76789]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0921e2-e134-4c81-abeb-f5cb57869806]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8146ae4a-c0cd-4cd0-95aa-33badd456afe]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc20f150-5871-4741-9249-3bcae844e817]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfb0f80-da16-4078-ba85-0ab915d9e7dc]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260]
Aug 26 15:02:44 user nova-compute[73052]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260] successful.
Aug 26 15:02:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[274d8777-68a7-46e0-beb3-3c6342b0f9b7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== disconnect_volume: return (337ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Start _get_guest_xml network_info=[{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'a7dcfc57-f864-4da8-ae78-bb9bd4f8f5cc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVBnAPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '9bdcc677-a1c4-4fc9-87b9-28a9babf53af', 'attached_at': '', 'detached_at': '', 'volume_id': '529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9', 'serial': '529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'numa_topology' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.objects.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:44 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:02:44 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.objects.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVBnAPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:44 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[01080aba-38fb-495c-8256-6f054f03a5cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:02:44 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fce2f2-94d4-4869-85f3-36567bcf1892]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9] added
Aug 26 15:02:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f342fe9-bd78-4b64-9d5e-e43f9d66ad9c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[100e38e1-bd8e-4585-9171-3cb4f58d5eaf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wVBnAPrp {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wVBnAPrp" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[08686d9e-3a11-4c95-98e2-92db4d79b402]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wVBnAPrp'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccdf325-4b57-45b2-b9c4-1249aa9f46f6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6e9ed4-d5fa-4349-b5fb-0929142f9c45]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:44 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ba91ef-911a-49da-98df-672bee8531bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260]
Aug 26 15:02:45 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260] successful.
Aug 26 15:02:45 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f8c0ae-f78e-46c1-ac20-d7b4fc64b6af]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a47c54-bf40-4f8c-8b77-5b21644d6c9c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:45 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:45 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:45 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a49b39f-9986-44a5-b77e-df5bd2f5b3a3]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVBnAPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:45 user nova-compute[73052]: INFO nova.compute.manager [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Detaching volume 39f97208-2fe6-4944-9bf7-2380662e34d0
Aug 26 15:02:45 user nova-compute[73052]: INFO nova.virt.block_device [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Attempting to driver detach volume 39f97208-2fe6-4944-9bf7-2380662e34d0 from mountpoint /dev/vdb
Aug 26 15:02:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Attempting to detach device vdb from instance 27d11424-e15f-4561-84d0-82827ac35efd from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:02:45 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:02:45 user nova-compute[73052]:   <source dev="/dev/sdg"/>
Aug 26 15:02:45 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:02:45 user nova-compute[73052]:   <serial>39f97208-2fe6-4944-9bf7-2380662e34d0</serial>
Aug 26 15:02:45 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:02:45 user nova-compute[73052]: </disk>
Aug 26 15:02:45 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:02:45 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Successfully detached device vdb from instance 27d11424-e15f-4561-84d0-82827ac35efd from the persistent domain config.
Aug 26 15:02:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27d11424-e15f-4561-84d0-82827ac35efd from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:02:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:02:45 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:02:45 user nova-compute[73052]:   <source dev="/dev/sdg"/>
Aug 26 15:02:45 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:02:45 user nova-compute[73052]:   <serial>39f97208-2fe6-4944-9bf7-2380662e34d0</serial>
Aug 26 15:02:45 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:02:45 user nova-compute[73052]: </disk>
Aug 26 15:02:45 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26436666261356132', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436666261356132', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.objects.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:02:46 user nova-compute[73052]:   <uuid>9bdcc677-a1c4-4fc9-87b9-28a9babf53af</uuid>
Aug 26 15:02:46 user nova-compute[73052]:   <name>instance-00000025</name>
Aug 26 15:02:46 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:02:46 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:02:46 user nova-compute[73052]:   <metadata>
Aug 26 15:02:46 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:02:46 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:02:46 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeTestJSON-server-1311299839</nova:name>
Aug 26 15:02:46 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:02:44</nova:creationTime>
Aug 26 15:02:46 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:02:46 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:02:46 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:02:46 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:02:46 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:02:46 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:02:46 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:02:46 user nova-compute[73052]:       <nova:owner>
Aug 26 15:02:46 user nova-compute[73052]:         <nova:user uuid="8677e9414700404ea8a9cf07cae299b2">tempest-AttachVolumeTestJSON-68461294-project-member</nova:user>
Aug 26 15:02:46 user nova-compute[73052]:         <nova:project uuid="f05c842807aa4763b4e319c8098ba064">tempest-AttachVolumeTestJSON-68461294</nova:project>
Aug 26 15:02:46 user nova-compute[73052]:       </nova:owner>
Aug 26 15:02:46 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:02:46 user nova-compute[73052]:       <nova:ports>
Aug 26 15:02:46 user nova-compute[73052]:         <nova:port uuid="3a404e9c-e1ad-4c05-a706-f39084d8a5df">
Aug 26 15:02:46 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 15:02:46 user nova-compute[73052]:         </nova:port>
Aug 26 15:02:46 user nova-compute[73052]:       </nova:ports>
Aug 26 15:02:46 user nova-compute[73052]:     </nova:instance>
Aug 26 15:02:46 user nova-compute[73052]:   </metadata>
Aug 26 15:02:46 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:02:46 user nova-compute[73052]:     <system>
Aug 26 15:02:46 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:02:46 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:02:46 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:02:46 user nova-compute[73052]:       <entry name="serial">9bdcc677-a1c4-4fc9-87b9-28a9babf53af</entry>
Aug 26 15:02:46 user nova-compute[73052]:       <entry name="uuid">9bdcc677-a1c4-4fc9-87b9-28a9babf53af</entry>
Aug 26 15:02:46 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:02:46 user nova-compute[73052]:     </system>
Aug 26 15:02:46 user nova-compute[73052]:   </sysinfo>
Aug 26 15:02:46 user nova-compute[73052]:   <os>
Aug 26 15:02:46 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:02:46 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:02:46 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:02:46 user nova-compute[73052]:   </os>
Aug 26 15:02:46 user nova-compute[73052]:   <features>
Aug 26 15:02:46 user nova-compute[73052]:     <acpi/>
Aug 26 15:02:46 user nova-compute[73052]:     <apic/>
Aug 26 15:02:46 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:02:46 user nova-compute[73052]:   </features>
Aug 26 15:02:46 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:02:46 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:02:46 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:02:46 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:02:46 user nova-compute[73052]:   </clock>
Aug 26 15:02:46 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:02:46 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:02:46 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:02:46 user nova-compute[73052]:   </cpu>
Aug 26 15:02:46 user nova-compute[73052]:   <devices>
Aug 26 15:02:46 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:02:46 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:02:46 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk"/>
Aug 26 15:02:46 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:02:46 user nova-compute[73052]:     </disk>
Aug 26 15:02:46 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:02:46 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:02:46 user nova-compute[73052]:       <source dev="/dev/sdc"/>
Aug 26 15:02:46 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 15:02:46 user nova-compute[73052]:       <serial>529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9</serial>
Aug 26 15:02:46 user nova-compute[73052]:     </disk>
Aug 26 15:02:46 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:02:46 user nova-compute[73052]:       <mac address="fa:16:3e:e8:36:41"/>
Aug 26 15:02:46 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:02:46 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:02:46 user nova-compute[73052]:       <target dev="tap3a404e9c-e1"/>
Aug 26 15:02:46 user nova-compute[73052]:     </interface>
Aug 26 15:02:46 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:02:46 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/console.log" append="off"/>
Aug 26 15:02:46 user nova-compute[73052]:     </serial>
Aug 26 15:02:46 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:02:46 user nova-compute[73052]:     <video>
Aug 26 15:02:46 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:02:46 user nova-compute[73052]:     </video>
Aug 26 15:02:46 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:02:46 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:02:46 user nova-compute[73052]:     </rng>
Aug 26 15:02:46 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:02:46 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:02:46 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:02:46 user nova-compute[73052]:     </memballoon>
Aug 26 15:02:46 user nova-compute[73052]:   </devices>
Aug 26 15:02:46 user nova-compute[73052]: </domain>
Aug 26 15:02:46 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693062166.3396971, 27d11424-e15f-4561-84d0-82827ac35efd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27d11424-e15f-4561-84d0-82827ac35efd {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:02:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Successfully detached device vdb from instance 27d11424-e15f-4561-84d0-82827ac35efd from the live domain config.
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNRaJefh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:02:46 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d567b98-5f3b-45aa-9f83-dc34d6e892c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[525e1ef1-5f32-459b-883d-8ecc08754965]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 (non-flash)
Aug 26 15:02:46 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:02:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08b4e5a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0'): ({'sdg'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Removing single pathed devices sdg {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[35027d2c-2865-4355-b6f9-4b7ac2be9d73]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bb6c5e-a475-45f4-81ac-f07e67b83659]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Flushing IO for device /dev/sdg {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[818175b4-7563-465e-9902-0f42cc873579]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e411e9-f35a-4d61-a4d3-16432a88d26e]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] SCSI volumes sdg have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b6787c-d2a1-4d0a-b229-107da41358e0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.objects.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eade925c-f4c2-432e-8881-ccda32ed7c85]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0, portal: 172.16.0.220,3260]
Aug 26 15:02:46 user nova-compute[73052]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0, portal: 172.16.0.220,3260] successful.
Aug 26 15:02:46 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39f97208-2fe6-4944-9bf7-2380662e34d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c0857a-77b5-49eb-b082-d4b0ca25f7df]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] <== disconnect_volume: return (407ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:02:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Cannot resize image /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'migration_context' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG nova.objects.base [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG os_vif [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a404e9c-e1, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a404e9c-e1, col_values=(('external_ids', {'iface-id': '3a404e9c-e1ad-4c05-a706-f39084d8a5df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:36:41', 'vm-uuid': '9bdcc677-a1c4-4fc9-87b9-28a9babf53af'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:47 user nova-compute[73052]: INFO os_vif [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1')
Aug 26 15:02:47 user nova-compute[73052]: DEBUG nova.objects.instance [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'flavor' on Instance uuid 27d11424-e15f-4561-84d0-82827ac35efd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:02:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-067ae915-1786-4d45-874a-2c6902817ff7 tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.033s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-db4222b9-8ed4-4c9e-834e-5162ab6c71b0 req-df348dc2-f1e8-4476-8eef-cd18060c98d0 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db4222b9-8ed4-4c9e-834e-5162ab6c71b0 req-df348dc2-f1e8-4476-8eef-cd18060c98d0 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db4222b9-8ed4-4c9e-834e-5162ab6c71b0 req-df348dc2-f1e8-4476-8eef-cd18060c98d0 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-db4222b9-8ed4-4c9e-834e-5162ab6c71b0 req-df348dc2-f1e8-4476-8eef-cd18060c98d0 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-db4222b9-8ed4-4c9e-834e-5162ab6c71b0 req-df348dc2-f1e8-4476-8eef-cd18060c98d0 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:02:48 user nova-compute[73052]: WARNING nova.compute.manager [req-db4222b9-8ed4-4c9e-834e-5162ab6c71b0 req-df348dc2-f1e8-4476-8eef-cd18060c98d0 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state powering-on.
Aug 26 15:02:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062171.002381, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:02:51 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Resumed (Lifecycle Event)
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:02:51 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance rebooted successfully.
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-e5e33673-d2bf-487a-87e7-853d73dd3a0d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-d24e7e8b-5406-4231-99aa-1e86acede0d9 req-0da2718a-54f3-4145-88cf-5b54d2a89bd1 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:02:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d24e7e8b-5406-4231-99aa-1e86acede0d9 req-0da2718a-54f3-4145-88cf-5b54d2a89bd1 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:02:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d24e7e8b-5406-4231-99aa-1e86acede0d9 req-0da2718a-54f3-4145-88cf-5b54d2a89bd1 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:02:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d24e7e8b-5406-4231-99aa-1e86acede0d9 req-0da2718a-54f3-4145-88cf-5b54d2a89bd1 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-d24e7e8b-5406-4231-99aa-1e86acede0d9 req-0da2718a-54f3-4145-88cf-5b54d2a89bd1 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:02:51 user nova-compute[73052]: WARNING nova.compute.manager [req-d24e7e8b-5406-4231-99aa-1e86acede0d9 req-0da2718a-54f3-4145-88cf-5b54d2a89bd1 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state powering-on.
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:02:51 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062171.003776, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:02:51 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Started (Lifecycle Event)
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:02:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:02:51 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 15:02:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:02:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:03:01 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Creating image(s)
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Ensure instance console log exists: /opt/stack/data/nova/instances/f15dddfa-46f0-44d7-92cd-d6191d722670/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Start _get_guest_xml network_info=[{"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'aac86655-5bee-4dd0-97ca-9e80c4699220', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmjzkDKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f15dddfa-46f0-44d7-92cd-d6191d722670', 'attached_at': '', 'detached_at': '', 'volume_id': '310aaf44-72dc-44c6-b7eb-df6a07ae3084', 'serial': '310aaf44-72dc-44c6-b7eb-df6a07ae3084'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:03:01 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:03:01 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmjzkDKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:03:01 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:03:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:03:01 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:03:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:03:01 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9633393-203c-4353-a4e3-bbf0f1cd6446]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:03:01 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a217de-79c8-40fe-aec0-e5cc9e1ec2ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084] added
Aug 26 15:03:01 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d863d-b6ea-4f72-bea8-2f64bdb7d9d1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[588336f4-fead-4a74-9ad0-751e75f6db91]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmjzkDKl {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmjzkDKl" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8db723-020e-4821-9270-b590dadea048]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UmjzkDKl'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7534cdb4-d79f-4b23-b1b7-160bfd54f117]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f403007-09c3-48bb-a8f9-acbf20307997]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[34982460-4781-4661-b0b8-4fe520a2686e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084, portal: 172.16.0.220,3260]
Aug 26 15:03:02 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084, portal: 172.16.0.220,3260] successful.
Aug 26 15:03:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c52cf8-9695-4291-9abe-2f73396ef320]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8295711e-8790-4d6d-84fc-445cb06f0f5a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:02 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] HCTL ('38', '-', '-', 0) found on session 52 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[383e91a8-8fa1-491c-96f1-479e582ec2bf]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Searching for a device in session 52 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:03:02 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmjzkDKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23437306238383133', 'path': '/dev/sdg'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437306238383133', 'path': '/dev/sdg'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-703431785',display_name='tempest-TestVolumeBootPattern-server-703431785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-703431785',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-pxhs2g00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:02:30Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=f15dddfa-46f0-44d7-92cd-d6191d722670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:94:41,bridge_name='br-int',has_traffic_filtering=True,id=ca69b639-25df-404d-9907-6e2a17d556c9,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca69b639-25') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'pci_devices' on Instance uuid f15dddfa-46f0-44d7-92cd-d6191d722670 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:03:03 user nova-compute[73052]:   <uuid>f15dddfa-46f0-44d7-92cd-d6191d722670</uuid>
Aug 26 15:03:03 user nova-compute[73052]:   <name>instance-0000002b</name>
Aug 26 15:03:03 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:03:03 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:03:03 user nova-compute[73052]:   <metadata>
Aug 26 15:03:03 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:03:03 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:03:03 user nova-compute[73052]:       <nova:name>tempest-TestVolumeBootPattern-server-703431785</nova:name>
Aug 26 15:03:03 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:03:01</nova:creationTime>
Aug 26 15:03:03 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:03:03 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:03:03 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:03:03 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:03:03 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:03:03 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:03:03 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:03:03 user nova-compute[73052]:       <nova:owner>
Aug 26 15:03:03 user nova-compute[73052]:         <nova:user uuid="ce6cd78a2f7c407983d90a15ffb94967">tempest-TestVolumeBootPattern-772605316-project-member</nova:user>
Aug 26 15:03:03 user nova-compute[73052]:         <nova:project uuid="1e8ab154558a4521920e05921722db36">tempest-TestVolumeBootPattern-772605316</nova:project>
Aug 26 15:03:03 user nova-compute[73052]:       </nova:owner>
Aug 26 15:03:03 user nova-compute[73052]:       <nova:ports>
Aug 26 15:03:03 user nova-compute[73052]:         <nova:port uuid="ca69b639-25df-404d-9907-6e2a17d556c9">
Aug 26 15:03:03 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 15:03:03 user nova-compute[73052]:         </nova:port>
Aug 26 15:03:03 user nova-compute[73052]:       </nova:ports>
Aug 26 15:03:03 user nova-compute[73052]:     </nova:instance>
Aug 26 15:03:03 user nova-compute[73052]:   </metadata>
Aug 26 15:03:03 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:03:03 user nova-compute[73052]:     <system>
Aug 26 15:03:03 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:03:03 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:03:03 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:03:03 user nova-compute[73052]:       <entry name="serial">f15dddfa-46f0-44d7-92cd-d6191d722670</entry>
Aug 26 15:03:03 user nova-compute[73052]:       <entry name="uuid">f15dddfa-46f0-44d7-92cd-d6191d722670</entry>
Aug 26 15:03:03 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:03:03 user nova-compute[73052]:     </system>
Aug 26 15:03:03 user nova-compute[73052]:   </sysinfo>
Aug 26 15:03:03 user nova-compute[73052]:   <os>
Aug 26 15:03:03 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:03:03 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:03:03 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:03:03 user nova-compute[73052]:   </os>
Aug 26 15:03:03 user nova-compute[73052]:   <features>
Aug 26 15:03:03 user nova-compute[73052]:     <acpi/>
Aug 26 15:03:03 user nova-compute[73052]:     <apic/>
Aug 26 15:03:03 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:03:03 user nova-compute[73052]:   </features>
Aug 26 15:03:03 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:03:03 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:03:03 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:03:03 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:03:03 user nova-compute[73052]:   </clock>
Aug 26 15:03:03 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:03:03 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:03:03 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:03:03 user nova-compute[73052]:   </cpu>
Aug 26 15:03:03 user nova-compute[73052]:   <devices>
Aug 26 15:03:03 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:03:03 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:03:03 user nova-compute[73052]:       <source dev="/dev/sdg"/>
Aug 26 15:03:03 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:03:03 user nova-compute[73052]:       <serial>310aaf44-72dc-44c6-b7eb-df6a07ae3084</serial>
Aug 26 15:03:03 user nova-compute[73052]:     </disk>
Aug 26 15:03:03 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:03:03 user nova-compute[73052]:       <mac address="fa:16:3e:2a:94:41"/>
Aug 26 15:03:03 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:03:03 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:03:03 user nova-compute[73052]:       <target dev="tapca69b639-25"/>
Aug 26 15:03:03 user nova-compute[73052]:     </interface>
Aug 26 15:03:03 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:03:03 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/f15dddfa-46f0-44d7-92cd-d6191d722670/console.log" append="off"/>
Aug 26 15:03:03 user nova-compute[73052]:     </serial>
Aug 26 15:03:03 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:03:03 user nova-compute[73052]:     <video>
Aug 26 15:03:03 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:03:03 user nova-compute[73052]:     </video>
Aug 26 15:03:03 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:03:03 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:03:03 user nova-compute[73052]:     </rng>
Aug 26 15:03:03 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:03:03 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:03:03 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:03:03 user nova-compute[73052]:     </memballoon>
Aug 26 15:03:03 user nova-compute[73052]:   </devices>
Aug 26 15:03:03 user nova-compute[73052]: </domain>
Aug 26 15:03:03 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-703431785',display_name='tempest-TestVolumeBootPattern-server-703431785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-703431785',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-pxhs2g00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:02:30Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=f15dddfa-46f0-44d7-92cd-d6191d722670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:94:41,bridge_name='br-int',has_traffic_filtering=True,id=ca69b639-25df-404d-9907-6e2a17d556c9,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca69b639-25') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG os_vif [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:94:41,bridge_name='br-int',has_traffic_filtering=True,id=ca69b639-25df-404d-9907-6e2a17d556c9,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca69b639-25') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca69b639-25, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca69b639-25, col_values=(('external_ids', {'iface-id': 'ca69b639-25df-404d-9907-6e2a17d556c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:94:41', 'vm-uuid': 'f15dddfa-46f0-44d7-92cd-d6191d722670'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:03 user nova-compute[73052]: INFO os_vif [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:94:41,bridge_name='br-int',has_traffic_filtering=True,id=ca69b639-25df-404d-9907-6e2a17d556c9,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca69b639-25')
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:03:03 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] No VIF found with MAC fa:16:3e:2a:94:41, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:03:04 user nova-compute[73052]: DEBUG nova.compute.manager [req-510e0293-dca3-4684-9f0c-aa9c683bad11 req-a800ed97-d293-4ea3-b28e-88f3ed0b1557 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-changed-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:04 user nova-compute[73052]: DEBUG nova.compute.manager [req-510e0293-dca3-4684-9f0c-aa9c683bad11 req-a800ed97-d293-4ea3-b28e-88f3ed0b1557 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Refreshing instance network info cache due to event network-changed-008d9525-e93d-40f5-ac18-aa9696c0fd7a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:03:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-510e0293-dca3-4684-9f0c-aa9c683bad11 req-a800ed97-d293-4ea3-b28e-88f3ed0b1557 service nova] Acquiring lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:03:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-510e0293-dca3-4684-9f0c-aa9c683bad11 req-a800ed97-d293-4ea3-b28e-88f3ed0b1557 service nova] Acquired lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:03:04 user nova-compute[73052]: DEBUG nova.network.neutron [req-510e0293-dca3-4684-9f0c-aa9c683bad11 req-a800ed97-d293-4ea3-b28e-88f3ed0b1557 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Refreshing network info cache for port 008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:03:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-fed807e7-3413-4618-b4a6-61c1f7b04b61 req-262baeba-20cb-4476-8421-df70b18f4618 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fed807e7-3413-4618-b4a6-61c1f7b04b61 req-262baeba-20cb-4476-8421-df70b18f4618 service nova] Acquiring lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fed807e7-3413-4618-b4a6-61c1f7b04b61 req-262baeba-20cb-4476-8421-df70b18f4618 service nova] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fed807e7-3413-4618-b4a6-61c1f7b04b61 req-262baeba-20cb-4476-8421-df70b18f4618 service nova] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-fed807e7-3413-4618-b4a6-61c1f7b04b61 req-262baeba-20cb-4476-8421-df70b18f4618 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] No waiting events found dispatching network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:05 user nova-compute[73052]: WARNING nova.compute.manager [req-fed807e7-3413-4618-b4a6-61c1f7b04b61 req-262baeba-20cb-4476-8421-df70b18f4618 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received unexpected event network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 for instance with vm_state building and task_state spawning.
Aug 26 15:03:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG nova.network.neutron [req-510e0293-dca3-4684-9f0c-aa9c683bad11 req-a800ed97-d293-4ea3-b28e-88f3ed0b1557 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updated VIF entry in instance network info cache for port 008d9525-e93d-40f5-ac18-aa9696c0fd7a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG nova.network.neutron [req-510e0293-dca3-4684-9f0c-aa9c683bad11 req-a800ed97-d293-4ea3-b28e-88f3ed0b1557 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-510e0293-dca3-4684-9f0c-aa9c683bad11 req-a800ed97-d293-4ea3-b28e-88f3ed0b1557 service nova] Releasing lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:03:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-cc773c49-effd-4184-a58a-4b2663415f4a req-3ffcb3a1-4c98-43c4-8a47-32a9f9078ccb service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-changed-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:06 user nova-compute[73052]: DEBUG nova.compute.manager [req-cc773c49-effd-4184-a58a-4b2663415f4a req-3ffcb3a1-4c98-43c4-8a47-32a9f9078ccb service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Refreshing instance network info cache due to event network-changed-3d5216f0-f889-4824-b93f-2bccee3eba4d. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:03:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc773c49-effd-4184-a58a-4b2663415f4a req-3ffcb3a1-4c98-43c4-8a47-32a9f9078ccb service nova] Acquiring lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:03:06 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc773c49-effd-4184-a58a-4b2663415f4a req-3ffcb3a1-4c98-43c4-8a47-32a9f9078ccb service nova] Acquired lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:03:06 user nova-compute[73052]: DEBUG nova.network.neutron [req-cc773c49-effd-4184-a58a-4b2663415f4a req-3ffcb3a1-4c98-43c4-8a47-32a9f9078ccb service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Refreshing network info cache for port 3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:03:06 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Stashing vm_state: active {{(pid=73052) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.claims [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Claim successful on node user
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062187.1165402, f15dddfa-46f0-44d7-92cd-d6191d722670 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] VM Resumed (Lifecycle Event)
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Instance spawned successfully.
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.resource_tracker [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating resource usage from migration b57bb496-8ee0-4ddf-948e-716cd04cb7a8
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062187.1185956, f15dddfa-46f0-44d7-92cd-d6191d722670 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] VM Started (Lifecycle Event)
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.manager [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Took 38.16 seconds to build instance.
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c57c3e44-c94b-4e8c-baa6-8e5a7f46b59c tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.276s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.network.neutron [req-cc773c49-effd-4184-a58a-4b2663415f4a req-3ffcb3a1-4c98-43c4-8a47-32a9f9078ccb service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updated VIF entry in instance network info cache for port 3d5216f0-f889-4824-b93f-2bccee3eba4d. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.network.neutron [req-cc773c49-effd-4184-a58a-4b2663415f4a req-3ffcb3a1-4c98-43c4-8a47-32a9f9078ccb service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating instance_info_cache with network_info: [{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-7b13f0b7-b4ec-4087-8de4-2452bf2a3529 req-ab58dd3d-4393-4e0b-8266-3f45aaf0ad4c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7b13f0b7-b4ec-4087-8de4-2452bf2a3529 req-ab58dd3d-4393-4e0b-8266-3f45aaf0ad4c service nova] Acquiring lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7b13f0b7-b4ec-4087-8de4-2452bf2a3529 req-ab58dd3d-4393-4e0b-8266-3f45aaf0ad4c service nova] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7b13f0b7-b4ec-4087-8de4-2452bf2a3529 req-ab58dd3d-4393-4e0b-8266-3f45aaf0ad4c service nova] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.manager [req-7b13f0b7-b4ec-4087-8de4-2452bf2a3529 req-ab58dd3d-4393-4e0b-8266-3f45aaf0ad4c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] No waiting events found dispatching network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:07 user nova-compute[73052]: WARNING nova.compute.manager [req-7b13f0b7-b4ec-4087-8de4-2452bf2a3529 req-ab58dd3d-4393-4e0b-8266-3f45aaf0ad4c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received unexpected event network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 for instance with vm_state active and task_state None.
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cc773c49-effd-4184-a58a-4b2663415f4a req-3ffcb3a1-4c98-43c4-8a47-32a9f9078ccb service nova] Releasing lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.463s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:07 user nova-compute[73052]: INFO nova.compute.manager [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Migrating
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquired lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:03:07 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating instance_info_cache with network_info: [{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Releasing lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Starting migrate_disk_and_power_off {{(pid=73052) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:03:08 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance destroyed successfully.
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-767395342',display_name='tempest-ServerActionsTestOtherA-server-767395342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-767395342',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:01:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-t3a4pj50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=e1161d8d-aa8a-4eff-888e-c7b699a2b76f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-163085203-network", "vif_mac": "fa:16:3e:ba:bf:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-163085203-network", "vif_mac": "fa:16:3e:ba:bf:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_vif [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d5216f0-f8, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:03:08 user nova-compute[73052]: INFO os_vif [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8')
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okOuSIjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:03:08 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270d8e9-6015-48ad-afe7-b5f5db92775a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-unplugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] No waiting events found dispatching network-vif-unplugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:08 user nova-compute[73052]: WARNING nova.compute.manager [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received unexpected event network-vif-unplugged-3d5216f0-f889-4824-b93f-2bccee3eba4d for instance with vm_state active and task_state resize_migrating.
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] No waiting events found dispatching network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:08 user nova-compute[73052]: WARNING nova.compute.manager [req-96ae68a6-6928-4f87-a0d6-6c2f7df1c879 req-7a339741-54fd-4afc-9816-58c10aab4dc3 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received unexpected event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d for instance with vm_state active and task_state resize_migrating.
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1bc870-4594-4e77-b80b-c3707f37b19a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:08 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:08 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:08 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c6cca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:03:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[942be6b3-388a-4ca6-97a0-ba8eaffb3979]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd7318-b833-43d1-8679-794e63b74b61]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7546ef17-e1db-4756-81b4-64a1105259e5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e28876-503d-4335-bec9-bd423f2c31e7]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_450bc455', '/dev/disk/by-id/scsi-1SCST_BIO450bc455-7e9debdd665b69cd', '/dev/disk/by-id/scsi-23765396465626464') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[47941e9a-ce36-4955-a913-9a484340c1b0]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[58afba46-a379-4b3d-bc65-b6d33d3d3dd5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[240908b2-64cc-4393-8c77-00025091e016]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260]
Aug 26 15:03:09 user nova-compute[73052]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260] successful.
Aug 26 15:03:09 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c836c630-23b1-4c66-a171-c1552b71e7a7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== disconnect_volume: return (350ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:09 user nova-compute[73052]: INFO nova.compute.manager [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Detaching volume 4b072b40-22d7-4b1e-88ac-5cc49b0d8faf
Aug 26 15:03:09 user nova-compute[73052]: INFO nova.virt.block_device [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Attempting to driver detach volume 4b072b40-22d7-4b1e-88ac-5cc49b0d8faf from mountpoint /dev/vdb
Aug 26 15:03:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Attempting to detach device vdb from instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:03:09 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:03:09 user nova-compute[73052]:   <source dev="/dev/sdf"/>
Aug 26 15:03:09 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:03:09 user nova-compute[73052]:   <serial>4b072b40-22d7-4b1e-88ac-5cc49b0d8faf</serial>
Aug 26 15:03:09 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:03:09 user nova-compute[73052]: </disk>
Aug 26 15:03:09 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:03:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Successfully detached device vdb from instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 from the persistent domain config.
Aug 26 15:03:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:03:09 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:03:09 user nova-compute[73052]:   <source dev="/dev/sdf"/>
Aug 26 15:03:09 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:03:09 user nova-compute[73052]:   <serial>4b072b40-22d7-4b1e-88ac-5cc49b0d8faf</serial>
Aug 26 15:03:09 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:03:09 user nova-compute[73052]: </disk>
Aug 26 15:03:09 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:03:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693062190.2883718, 8a75e8d1-668a-4014-a476-a2e3730f01a8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:03:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Successfully detached device vdb from instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 from the live domain config.
Aug 26 15:03:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtiSPhQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:03:10 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6447d326-f44f-4cd0-9418-e746f24b4073]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[affe9ef4-2b75-4688-8eff-772110b783e3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:10 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:10 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:03:10 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:10 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:10 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:10 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:10 user nova-compute[73052]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf (non-flash)
Aug 26 15:03:10 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:10 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:10 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf'): ({'sdf'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Removing single pathed devices sdf {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Port 3d5216f0-f889-4824-b93f-2bccee3eba4d binding to destination host user is already ACTIVE {{(pid=73052) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[224a49e3-571f-45af-856b-62932aeaa3e0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bfd5e6-3597-4c3e-9b62-d39f881d7fd3]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Flushing IO for device /dev/sdf {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaa28df-be7e-4daf-a263-1c458b1f2bb8]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f423a42-b5cd-48fe-a846-59e34cd17ae4]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] SCSI volumes sdf have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f187d9ed-54e0-4e39-b36b-d3093bfc0932]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquired lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb114ce-3f04-4f11-8f74-9cb40ec5cf43]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf, portal: 172.16.0.220,3260]
Aug 26 15:03:10 user nova-compute[73052]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf, portal: 172.16.0.220,3260] successful.
Aug 26 15:03:10 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bbc7bf-f1fd-4c1c-b04d-ad053b38ec24]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] <== disconnect_volume: return (335ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:03:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG nova.network.neutron [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating instance_info_cache with network_info: [{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Releasing lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG os_brick.utils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd5cc6e-5a82-4d9a-b554-7f7a5b300642]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7644f094-b3d1-4c32-97bc-ad5b10b3a5fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b28588-9452-4392-bcca-76de181d20af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[809e854e-6498-4fd4-b6af-b223fe391690]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:03:11 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f865b5ad-b6b2-4a02-ba7c-c145310e9786]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG os_brick.utils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG nova.objects.instance [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'flavor' on Instance uuid 8a75e8d1-668a-4014-a476-a2e3730f01a8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5728b7b9-15be-4e8d-9efc-0fc0f31442e4 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.881s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.739s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:11 user nova-compute[73052]: INFO nova.compute.manager [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Terminating instance
Aug 26 15:03:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-89a14c2f-cb0d-452e-8654-12b38c529477 req-a5048a92-cd1d-408b-9858-32563fbd859f service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received event network-vif-unplugged-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-89a14c2f-cb0d-452e-8654-12b38c529477 req-a5048a92-cd1d-408b-9858-32563fbd859f service nova] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-89a14c2f-cb0d-452e-8654-12b38c529477 req-a5048a92-cd1d-408b-9858-32563fbd859f service nova] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-89a14c2f-cb0d-452e-8654-12b38c529477 req-a5048a92-cd1d-408b-9858-32563fbd859f service nova] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-89a14c2f-cb0d-452e-8654-12b38c529477 req-a5048a92-cd1d-408b-9858-32563fbd859f service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] No waiting events found dispatching network-vif-unplugged-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-89a14c2f-cb0d-452e-8654-12b38c529477 req-a5048a92-cd1d-408b-9858-32563fbd859f service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received event network-vif-unplugged-f2f6d721-3205-487b-9d64-73be2b946d5d for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:03:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Instance destroyed successfully.
Aug 26 15:03:12 user nova-compute[73052]: DEBUG nova.objects.instance [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lazy-loading 'resources' on Instance uuid 8a75e8d1-668a-4014-a476-a2e3730f01a8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-596244850',display_name='tempest-VolumesSnapshotTestJSON-instance-596244850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-596244850',id=38,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkNoMy3Ut/2ZjanoXBXdYM24nmfbtDlvGSedSntBt6X8ySw/rKGWhsai/Cg7V7Wu6gO2hC//57bYl5cURIkVk1zopTsF22QohotgNFgG4MO7BlpP53SzTBkLpUyRzo9EQ==',key_name='tempest-keypair-821469525',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec12a3cd3b3b4b13a00609468911ab32',ramdisk_id='',reservation_id='r-s0avpm0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2099506189',owner_user_name='tempest-VolumesSnapshotTestJSON-2099506189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='182f8d861f1d422aaa2ac5fbd8442f7f',uuid=8a75e8d1-668a-4014-a476-a2e3730f01a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converting VIF {"id": "f2f6d721-3205-487b-9d64-73be2b946d5d", "address": "fa:16:3e:2f:5a:2e", "network": {"id": "8d2b257e-6330-4321-a810-667a0dc253f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1322841980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec12a3cd3b3b4b13a00609468911ab32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f6d721-32", "ovs_interfaceid": "f2f6d721-3205-487b-9d64-73be2b946d5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:5a:2e,bridge_name='br-int',has_traffic_filtering=True,id=f2f6d721-3205-487b-9d64-73be2b946d5d,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f6d721-32') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_vif [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:5a:2e,bridge_name='br-int',has_traffic_filtering=True,id=f2f6d721-3205-487b-9d64-73be2b946d5d,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f6d721-32') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2f6d721-32, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:12 user nova-compute[73052]: INFO os_vif [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:5a:2e,bridge_name='br-int',has_traffic_filtering=True,id=f2f6d721-3205-487b-9d64-73be2b946d5d,network=Network(8d2b257e-6330-4321-a810-667a0dc253f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f6d721-32')
Aug 26 15:03:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtiSPhQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:03:12 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b072b40-22d7-4b1e-88ac-5cc49b0d8faf', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[204c94b3-f3ad-4ce9-9ed5-b0fda6081b82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20e80f5-ca20-4bef-8043-8434459b936e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:12 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:12 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:12 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:12 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:12 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:12 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:12 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:12 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c752320>, {}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Disconnecting from: [] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] <== disconnect_volume: return (57ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:03:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Deleting instance files /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8_del
Aug 26 15:03:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Deletion of /opt/stack/data/nova/instances/8a75e8d1-668a-4014-a476-a2e3730f01a8_del complete
Aug 26 15:03:12 user nova-compute[73052]: INFO nova.compute.manager [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 15:03:12 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:03:12 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:13 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Took 0.87 seconds to deallocate network for instance.
Aug 26 15:03:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-bafb2e36-09b2-4d2e-97b8-dae1fe2e4c15 req-48ad1d40-601d-4d1c-b065-cc3c7cba042e service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received event network-vif-deleted-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:13 user nova-compute[73052]: INFO nova.compute.manager [req-bafb2e36-09b2-4d2e-97b8-dae1fe2e4c15 req-48ad1d40-601d-4d1c-b065-cc3c7cba042e service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Neutron deleted interface f2f6d721-3205-487b-9d64-73be2b946d5d; detaching it from the instance and deleting it from the info cache
Aug 26 15:03:13 user nova-compute[73052]: DEBUG nova.network.neutron [req-bafb2e36-09b2-4d2e-97b8-dae1fe2e4c15 req-48ad1d40-601d-4d1c-b065-cc3c7cba042e service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:13 user nova-compute[73052]: WARNING nova.volume.cinder [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Attachment 6f531aaa-1102-4218-9152-559798ee46f9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6f531aaa-1102-4218-9152-559798ee46f9. (HTTP 404) (Request-ID: req-c1717728-e1ef-4cab-b3dc-4e64fa3365a3)
Aug 26 15:03:13 user nova-compute[73052]: INFO nova.compute.manager [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 15:03:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-bafb2e36-09b2-4d2e-97b8-dae1fe2e4c15 req-48ad1d40-601d-4d1c-b065-cc3c7cba042e service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Detach interface failed, port_id=f2f6d721-3205-487b-9d64-73be2b946d5d, reason: Instance 8a75e8d1-668a-4014-a476-a2e3730f01a8 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:13 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Deleted allocations for instance 8a75e8d1-668a-4014-a476-a2e3730f01a8
Aug 26 15:03:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-1d03f562-dd92-48fc-bea3-2bc3cc8d8f74 req-e27e319b-6088-4485-8c8c-4903fd6f2032 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received event network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1d03f562-dd92-48fc-bea3-2bc3cc8d8f74 req-e27e319b-6088-4485-8c8c-4903fd6f2032 service nova] Acquiring lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1d03f562-dd92-48fc-bea3-2bc3cc8d8f74 req-e27e319b-6088-4485-8c8c-4903fd6f2032 service nova] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1d03f562-dd92-48fc-bea3-2bc3cc8d8f74 req-e27e319b-6088-4485-8c8c-4903fd6f2032 service nova] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-1d03f562-dd92-48fc-bea3-2bc3cc8d8f74 req-e27e319b-6088-4485-8c8c-4903fd6f2032 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] No waiting events found dispatching network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:13 user nova-compute[73052]: WARNING nova.compute.manager [req-1d03f562-dd92-48fc-bea3-2bc3cc8d8f74 req-e27e319b-6088-4485-8c8c-4903fd6f2032 service nova] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Received unexpected event network-vif-plugged-f2f6d721-3205-487b-9d64-73be2b946d5d for instance with vm_state deleted and task_state None.
Aug 26 15:03:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-ac5d8514-96a5-471b-98fd-0f0674742b30 tempest-VolumesSnapshotTestJSON-2099506189 tempest-VolumesSnapshotTestJSON-2099506189-project-member] Lock "8a75e8d1-668a-4014-a476-a2e3730f01a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.437s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:03:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:18 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:03:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:03:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:03:21 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:03:21 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7647MB free_disk=24.951251983642578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Applying migration context for instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f as it has an incoming, in-progress migration b57bb496-8ee0-4ddf-948e-716cd04cb7a8. Migration status is post-migrating {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 15:03:21 user nova-compute[73052]: INFO nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating resource usage from migration b57bb496-8ee0-4ddf-948e-716cd04cb7a8
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 27d11424-e15f-4561-84d0-82827ac35efd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f15dddfa-46f0-44d7-92cd-d6191d722670 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Migration b57bb496-8ee0-4ddf-948e-716cd04cb7a8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:03:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:03:22 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:03:22 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:03:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:03:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Starting finish_migration {{(pid=73052) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance directory exists: not creating {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 15:03:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Creating image(s)
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Ensure instance console log exists: /opt/stack/data/nova/instances/e1161d8d-aa8a-4eff-888e-c7b699a2b76f/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Start _get_guest_xml network_info=[{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-163085203-network", "vif_mac": "fa:16:3e:ba:bf:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '1b708ea8-2a83-4a5d-ab6a-95e8b4a79c55', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okOuSIjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e1161d8d-aa8a-4eff-888e-c7b699a2b76f', 'attached_at': '2023-08-26T15:03:23.000000', 'detached_at': '', 'volume_id': 'edc0155b-369c-4c7b-9480-f11c829e00f9', 'serial': 'edc0155b-369c-4c7b-9480-f11c829e00f9'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:03:23 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:03:23 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okOuSIjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:03:23 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:03:23 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:03:23 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a780d282-41d7-427e-a9fc-5a9eefb01ed0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:03:23 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3e00c4-7990-4532-915d-a16128f1aaee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9] added
Aug 26 15:03:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[772c6656-663d-4f20-bf03-0949d9308878]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83fd0f-70c8-40e7-ad34-f88b995b06a3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okOuSIjL {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okOuSIjL" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ce4335-030c-4f4c-be53-a5b9dafd72b3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'okOuSIjL'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[98afd5de-5e42-4dd3-a53c-1abe82737970]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3456f1-8d89-411f-be00-580362caff1e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7990b60a-d0b2-4b34-822b-11e6e28b9331]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260]
Aug 26 15:03:23 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260] successful.
Aug 26 15:03:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[11775b04-7624-46a9-97a8-163884289ee4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa86abe8-428e-4224-b1be-2245375b315d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:03:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d07777-fdba-4858-a85d-78941ee71790]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okOuSIjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062188.876548, e1161d8d-aa8a-4eff-888e-c7b699a2b76f => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:03:23 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] VM Stopped (Lifecycle Event)
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-a20aeafe-4449-481d-845b-38e11d6896ff None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:03:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-a20aeafe-4449-481d-845b-38e11d6896ff None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:03:23 user nova-compute[73052]: INFO nova.compute.manager [None req-a20aeafe-4449-481d-845b-38e11d6896ff None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 15:03:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23765396465626464', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765396465626464', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-767395342',display_name='tempest-ServerActionsTestOtherA-server-767395342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-767395342',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:01:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-t3a4pj50',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=e1161d8d-aa8a-4eff-888e-c7b699a2b76f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-163085203-network", "vif_mac": "fa:16:3e:ba:bf:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-163085203-network", "vif_mac": "fa:16:3e:ba:bf:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:03:24 user nova-compute[73052]:   <uuid>e1161d8d-aa8a-4eff-888e-c7b699a2b76f</uuid>
Aug 26 15:03:24 user nova-compute[73052]:   <name>instance-0000002a</name>
Aug 26 15:03:24 user nova-compute[73052]:   <memory>2097152</memory>
Aug 26 15:03:24 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:03:24 user nova-compute[73052]:   <metadata>
Aug 26 15:03:24 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:03:24 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:03:24 user nova-compute[73052]:       <nova:name>tempest-ServerActionsTestOtherA-server-767395342</nova:name>
Aug 26 15:03:24 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:03:23</nova:creationTime>
Aug 26 15:03:24 user nova-compute[73052]:       <nova:flavor name="m1.small">
Aug 26 15:03:24 user nova-compute[73052]:         <nova:memory>2048</nova:memory>
Aug 26 15:03:24 user nova-compute[73052]:         <nova:disk>20</nova:disk>
Aug 26 15:03:24 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:03:24 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:03:24 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:03:24 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:03:24 user nova-compute[73052]:       <nova:owner>
Aug 26 15:03:24 user nova-compute[73052]:         <nova:user uuid="5061033588974e7ead6c7abc8a47308e">tempest-ServerActionsTestOtherA-1682869035-project-member</nova:user>
Aug 26 15:03:24 user nova-compute[73052]:         <nova:project uuid="eb3fc9a170804f0ebfa2dde967e3fec2">tempest-ServerActionsTestOtherA-1682869035</nova:project>
Aug 26 15:03:24 user nova-compute[73052]:       </nova:owner>
Aug 26 15:03:24 user nova-compute[73052]:       <nova:ports>
Aug 26 15:03:24 user nova-compute[73052]:         <nova:port uuid="3d5216f0-f889-4824-b93f-2bccee3eba4d">
Aug 26 15:03:24 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 15:03:24 user nova-compute[73052]:         </nova:port>
Aug 26 15:03:24 user nova-compute[73052]:       </nova:ports>
Aug 26 15:03:24 user nova-compute[73052]:     </nova:instance>
Aug 26 15:03:24 user nova-compute[73052]:   </metadata>
Aug 26 15:03:24 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:03:24 user nova-compute[73052]:     <system>
Aug 26 15:03:24 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:03:24 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:03:24 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:03:24 user nova-compute[73052]:       <entry name="serial">e1161d8d-aa8a-4eff-888e-c7b699a2b76f</entry>
Aug 26 15:03:24 user nova-compute[73052]:       <entry name="uuid">e1161d8d-aa8a-4eff-888e-c7b699a2b76f</entry>
Aug 26 15:03:24 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:03:24 user nova-compute[73052]:     </system>
Aug 26 15:03:24 user nova-compute[73052]:   </sysinfo>
Aug 26 15:03:24 user nova-compute[73052]:   <os>
Aug 26 15:03:24 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:03:24 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:03:24 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:03:24 user nova-compute[73052]:   </os>
Aug 26 15:03:24 user nova-compute[73052]:   <features>
Aug 26 15:03:24 user nova-compute[73052]:     <acpi/>
Aug 26 15:03:24 user nova-compute[73052]:     <apic/>
Aug 26 15:03:24 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:03:24 user nova-compute[73052]:   </features>
Aug 26 15:03:24 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:03:24 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:03:24 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:03:24 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:03:24 user nova-compute[73052]:   </clock>
Aug 26 15:03:24 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:03:24 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:03:24 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:03:24 user nova-compute[73052]:   </cpu>
Aug 26 15:03:24 user nova-compute[73052]:   <devices>
Aug 26 15:03:24 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:03:24 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:03:24 user nova-compute[73052]:       <source dev="/dev/sde"/>
Aug 26 15:03:24 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:03:24 user nova-compute[73052]:       <serial>edc0155b-369c-4c7b-9480-f11c829e00f9</serial>
Aug 26 15:03:24 user nova-compute[73052]:     </disk>
Aug 26 15:03:24 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:03:24 user nova-compute[73052]:       <mac address="fa:16:3e:ba:bf:ca"/>
Aug 26 15:03:24 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:03:24 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:03:24 user nova-compute[73052]:       <target dev="tap3d5216f0-f8"/>
Aug 26 15:03:24 user nova-compute[73052]:     </interface>
Aug 26 15:03:24 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:03:24 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/e1161d8d-aa8a-4eff-888e-c7b699a2b76f/console.log" append="off"/>
Aug 26 15:03:24 user nova-compute[73052]:     </serial>
Aug 26 15:03:24 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:03:24 user nova-compute[73052]:     <video>
Aug 26 15:03:24 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:03:24 user nova-compute[73052]:     </video>
Aug 26 15:03:24 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:03:24 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:03:24 user nova-compute[73052]:     </rng>
Aug 26 15:03:24 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:03:24 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:03:24 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:03:24 user nova-compute[73052]:     </memballoon>
Aug 26 15:03:24 user nova-compute[73052]:   </devices>
Aug 26 15:03:24 user nova-compute[73052]: </domain>
Aug 26 15:03:24 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-767395342',display_name='tempest-ServerActionsTestOtherA-server-767395342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-767395342',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:01:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-t3a4pj50',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=e1161d8d-aa8a-4eff-888e-c7b699a2b76f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-163085203-network", "vif_mac": "fa:16:3e:ba:bf:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-163085203-network", "vif_mac": "fa:16:3e:ba:bf:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG os_vif [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d5216f0-f8, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d5216f0-f8, col_values=(('external_ids', {'iface-id': '3d5216f0-f889-4824-b93f-2bccee3eba4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:bf:ca', 'vm-uuid': 'e1161d8d-aa8a-4eff-888e-c7b699a2b76f'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:24 user nova-compute[73052]: INFO os_vif [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8')
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:03:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] No VIF found with MAC fa:16:3e:ba:bf:ca, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG nova.compute.manager [req-38483f7c-02bb-46d4-8f69-c8942a569927 req-31038231-b2dd-4261-b62a-899977cf89e0 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38483f7c-02bb-46d4-8f69-c8942a569927 req-31038231-b2dd-4261-b62a-899977cf89e0 service nova] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38483f7c-02bb-46d4-8f69-c8942a569927 req-31038231-b2dd-4261-b62a-899977cf89e0 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38483f7c-02bb-46d4-8f69-c8942a569927 req-31038231-b2dd-4261-b62a-899977cf89e0 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:25 user nova-compute[73052]: DEBUG nova.compute.manager [req-38483f7c-02bb-46d4-8f69-c8942a569927 req-31038231-b2dd-4261-b62a-899977cf89e0 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] No waiting events found dispatching network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:25 user nova-compute[73052]: WARNING nova.compute.manager [req-38483f7c-02bb-46d4-8f69-c8942a569927 req-31038231-b2dd-4261-b62a-899977cf89e0 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received unexpected event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d for instance with vm_state active and task_state resize_finish.
Aug 26 15:03:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062192.3976161, 8a75e8d1-668a-4014-a476-a2e3730f01a8 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:03:27 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] VM Stopped (Lifecycle Event)
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4ace30a7-1424-4b4c-9ddf-025102368c03 None None] [instance: 8a75e8d1-668a-4014-a476-a2e3730f01a8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062207.909933, e1161d8d-aa8a-4eff-888e-c7b699a2b76f => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:03:27 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] VM Resumed (Lifecycle Event)
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:03:27 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance running successfully.
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Failed to set time: agent not configured {{(pid=73052) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c21201f3-9891-43dd-9277-635fe1e8e19d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] finish_migration finished successfully. {{(pid=73052) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:03:27 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062207.9127018, e1161d8d-aa8a-4eff-888e-c7b699a2b76f => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:03:27 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] VM Started (Lifecycle Event)
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:03:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:03:27 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 15:03:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-c46d8893-2e30-4e1b-9480-2e9837707ee3 req-c279edfb-8184-403c-aa7e-981e65d22ec9 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c46d8893-2e30-4e1b-9480-2e9837707ee3 req-c279edfb-8184-403c-aa7e-981e65d22ec9 service nova] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c46d8893-2e30-4e1b-9480-2e9837707ee3 req-c279edfb-8184-403c-aa7e-981e65d22ec9 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c46d8893-2e30-4e1b-9480-2e9837707ee3 req-c279edfb-8184-403c-aa7e-981e65d22ec9 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-c46d8893-2e30-4e1b-9480-2e9837707ee3 req-c279edfb-8184-403c-aa7e-981e65d22ec9 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] No waiting events found dispatching network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:28 user nova-compute[73052]: WARNING nova.compute.manager [req-c46d8893-2e30-4e1b-9480-2e9837707ee3 req-c279edfb-8184-403c-aa7e-981e65d22ec9 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received unexpected event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d for instance with vm_state active and task_state resize_finish.
Aug 26 15:03:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-ef0b7b33-ee39-416e-aeb6-5cb20c994ba5 req-3f76982e-e86c-4e41-9bc5-ec891364b133 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-changed-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-ef0b7b33-ee39-416e-aeb6-5cb20c994ba5 req-3f76982e-e86c-4e41-9bc5-ec891364b133 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Refreshing instance network info cache due to event network-changed-60cc7257-0309-4a6a-acc5-4af2cb1afc86. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ef0b7b33-ee39-416e-aeb6-5cb20c994ba5 req-3f76982e-e86c-4e41-9bc5-ec891364b133 service nova] Acquiring lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ef0b7b33-ee39-416e-aeb6-5cb20c994ba5 req-3f76982e-e86c-4e41-9bc5-ec891364b133 service nova] Acquired lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG nova.network.neutron [req-ef0b7b33-ee39-416e-aeb6-5cb20c994ba5 req-3f76982e-e86c-4e41-9bc5-ec891364b133 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Refreshing network info cache for port 60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:36 user nova-compute[73052]: INFO nova.compute.manager [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Terminating instance
Aug 26 15:03:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-239f11e5-b731-460c-87ef-d7a70611448a req-74e6dd06-beaa-4898-a057-3dce985d7875 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-vif-unplugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-239f11e5-b731-460c-87ef-d7a70611448a req-74e6dd06-beaa-4898-a057-3dce985d7875 service nova] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-239f11e5-b731-460c-87ef-d7a70611448a req-74e6dd06-beaa-4898-a057-3dce985d7875 service nova] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-239f11e5-b731-460c-87ef-d7a70611448a req-74e6dd06-beaa-4898-a057-3dce985d7875 service nova] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-239f11e5-b731-460c-87ef-d7a70611448a req-74e6dd06-beaa-4898-a057-3dce985d7875 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] No waiting events found dispatching network-vif-unplugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-239f11e5-b731-460c-87ef-d7a70611448a req-74e6dd06-beaa-4898-a057-3dce985d7875 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-vif-unplugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:37 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Instance destroyed successfully.
Aug 26 15:03:37 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'resources' on Instance uuid 27d11424-e15f-4561-84d0-82827ac35efd {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2085795273',display_name='tempest-TestStampPattern-server-2085795273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2085795273',id=40,image_ref='9c2edd5e-6c24-4c58-8117-212b3fd9dd27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQexKIMfesKSv2hoelfaNzG2QIHClVDFpvVqLXF9gD62XnTHDVnS3avo8uiqbd9zSMsB18mkPPWxAFIuiGViQSleqODN9ZqAbPTDcng8pgHyinnPi9agAubqw/jrXpO7g==',key_name='tempest-TestStampPattern-1713822412',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8dfbc7f8018b4fd29aa4a2f246a85c11',ramdisk_id='',reservation_id='r-v6h1yi02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='de1ab010-f0e3-48c7-bc42-b2bb5746cc13',image_min_disk='1',image_min_ram='0',image_owner_id='8dfbc7f8018b4fd29aa4a2f246a85c11',image_owner_project_name='tempest-TestStampPattern-1398027688',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1398027688-project-member',image_user_id='d2625163eb644872b43a7914dcca366b',owner_project_name='tempest-TestStampPattern-1398027688',owner_user_name='tempest-TestStampPattern-1398027688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:00:44Z,user_data=None,user_id='d2625163eb644872b43a7914dcca366b',uuid=27d11424-e15f-4561-84d0-82827ac35efd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converting VIF {"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=60cc7257-0309-4a6a-acc5-4af2cb1afc86,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60cc7257-03') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG os_vif [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=60cc7257-0309-4a6a-acc5-4af2cb1afc86,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60cc7257-03') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60cc7257-03, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:37 user nova-compute[73052]: INFO os_vif [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=60cc7257-0309-4a6a-acc5-4af2cb1afc86,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60cc7257-03')
Aug 26 15:03:37 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Deleting instance files /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd_del
Aug 26 15:03:37 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Deletion of /opt/stack/data/nova/instances/27d11424-e15f-4561-84d0-82827ac35efd_del complete
Aug 26 15:03:37 user nova-compute[73052]: INFO nova.compute.manager [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 15:03:37 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG nova.network.neutron [req-ef0b7b33-ee39-416e-aeb6-5cb20c994ba5 req-3f76982e-e86c-4e41-9bc5-ec891364b133 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updated VIF entry in instance network info cache for port 60cc7257-0309-4a6a-acc5-4af2cb1afc86. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG nova.network.neutron [req-ef0b7b33-ee39-416e-aeb6-5cb20c994ba5 req-3f76982e-e86c-4e41-9bc5-ec891364b133 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updating instance_info_cache with network_info: [{"id": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "address": "fa:16:3e:14:cc:48", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60cc7257-03", "ovs_interfaceid": "60cc7257-0309-4a6a-acc5-4af2cb1afc86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ef0b7b33-ee39-416e-aeb6-5cb20c994ba5 req-3f76982e-e86c-4e41-9bc5-ec891364b133 service nova] Releasing lock "refresh_cache-27d11424-e15f-4561-84d0-82827ac35efd" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:03:38 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Took 0.77 seconds to deallocate network for instance.
Aug 26 15:03:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:38 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Deleted allocations for instance 27d11424-e15f-4561-84d0-82827ac35efd
Aug 26 15:03:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7549a23-d890-41bf-a872-50ff0406e58c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "27d11424-e15f-4561-84d0-82827ac35efd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-10dfe0db-b107-4914-ba96-31c7094639a6 req-da9df375-d167-41cf-b859-00160cd7d861 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-10dfe0db-b107-4914-ba96-31c7094639a6 req-da9df375-d167-41cf-b859-00160cd7d861 service nova] Acquiring lock "27d11424-e15f-4561-84d0-82827ac35efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-10dfe0db-b107-4914-ba96-31c7094639a6 req-da9df375-d167-41cf-b859-00160cd7d861 service nova] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-10dfe0db-b107-4914-ba96-31c7094639a6 req-da9df375-d167-41cf-b859-00160cd7d861 service nova] Lock "27d11424-e15f-4561-84d0-82827ac35efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:03:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-10dfe0db-b107-4914-ba96-31c7094639a6 req-da9df375-d167-41cf-b859-00160cd7d861 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] No waiting events found dispatching network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:03:38 user nova-compute[73052]: WARNING nova.compute.manager [req-10dfe0db-b107-4914-ba96-31c7094639a6 req-da9df375-d167-41cf-b859-00160cd7d861 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received unexpected event network-vif-plugged-60cc7257-0309-4a6a-acc5-4af2cb1afc86 for instance with vm_state deleted and task_state None.
Aug 26 15:03:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-10dfe0db-b107-4914-ba96-31c7094639a6 req-da9df375-d167-41cf-b859-00160cd7d861 service nova] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Received event network-vif-deleted-60cc7257-0309-4a6a-acc5-4af2cb1afc86 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:03:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:52 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062217.463576, 27d11424-e15f-4561-84d0-82827ac35efd => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:03:52 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] VM Stopped (Lifecycle Event)
Aug 26 15:03:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3bf77bea-c177-4810-beb4-4736663bbdf5 None None] [instance: 27d11424-e15f-4561-84d0-82827ac35efd] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:03:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:03:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:04:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updating instance_info_cache with network_info: [{"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:04:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:04:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:20 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:04:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-9c00fef7-c2b4-4300-8402-f9a83672f6b7 req-b9b7f654-95da-4e01-b42d-c2b7cc9e8779 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-changed-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-9c00fef7-c2b4-4300-8402-f9a83672f6b7 req-b9b7f654-95da-4e01-b42d-c2b7cc9e8779 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Refreshing instance network info cache due to event network-changed-ca69b639-25df-404d-9907-6e2a17d556c9. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9c00fef7-c2b4-4300-8402-f9a83672f6b7 req-b9b7f654-95da-4e01-b42d-c2b7cc9e8779 service nova] Acquiring lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9c00fef7-c2b4-4300-8402-f9a83672f6b7 req-b9b7f654-95da-4e01-b42d-c2b7cc9e8779 service nova] Acquired lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-9c00fef7-c2b4-4300-8402-f9a83672f6b7 req-b9b7f654-95da-4e01-b42d-c2b7cc9e8779 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Refreshing network info cache for port ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-9c00fef7-c2b4-4300-8402-f9a83672f6b7 req-b9b7f654-95da-4e01-b42d-c2b7cc9e8779 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updated VIF entry in instance network info cache for port ca69b639-25df-404d-9907-6e2a17d556c9. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-9c00fef7-c2b4-4300-8402-f9a83672f6b7 req-b9b7f654-95da-4e01-b42d-c2b7cc9e8779 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updating instance_info_cache with network_info: [{"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9c00fef7-c2b4-4300-8402-f9a83672f6b7 req-b9b7f654-95da-4e01-b42d-c2b7cc9e8779 service nova] Releasing lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-0427d84f-d2b7-42d9-af85-b1f8056c591f req-521c58a5-bc99-4ff2-91e8-7b877361396c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-changed-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-0427d84f-d2b7-42d9-af85-b1f8056c591f req-521c58a5-bc99-4ff2-91e8-7b877361396c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Refreshing instance network info cache due to event network-changed-ca69b639-25df-404d-9907-6e2a17d556c9. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0427d84f-d2b7-42d9-af85-b1f8056c591f req-521c58a5-bc99-4ff2-91e8-7b877361396c service nova] Acquiring lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0427d84f-d2b7-42d9-af85-b1f8056c591f req-521c58a5-bc99-4ff2-91e8-7b877361396c service nova] Acquired lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-0427d84f-d2b7-42d9-af85-b1f8056c591f req-521c58a5-bc99-4ff2-91e8-7b877361396c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Refreshing network info cache for port ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "f15dddfa-46f0-44d7-92cd-d6191d722670" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:22 user nova-compute[73052]: INFO nova.compute.manager [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Terminating instance
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-0427d84f-d2b7-42d9-af85-b1f8056c591f req-521c58a5-bc99-4ff2-91e8-7b877361396c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updated VIF entry in instance network info cache for port ca69b639-25df-404d-9907-6e2a17d556c9. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-0427d84f-d2b7-42d9-af85-b1f8056c591f req-521c58a5-bc99-4ff2-91e8-7b877361396c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updating instance_info_cache with network_info: [{"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0427d84f-d2b7-42d9-af85-b1f8056c591f req-521c58a5-bc99-4ff2-91e8-7b877361396c service nova] Releasing lock "refresh_cache-f15dddfa-46f0-44d7-92cd-d6191d722670" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:04:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Instance destroyed successfully.
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'resources' on Instance uuid f15dddfa-46f0-44d7-92cd-d6191d722670 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-703431785',display_name='tempest-TestVolumeBootPattern-server-703431785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-703431785',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-pxhs2g00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:03:07Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=f15dddfa-46f0-44d7-92cd-d6191d722670,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "ca69b639-25df-404d-9907-6e2a17d556c9", "address": "fa:16:3e:2a:94:41", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca69b639-25", "ovs_interfaceid": "ca69b639-25df-404d-9907-6e2a17d556c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:94:41,bridge_name='br-int',has_traffic_filtering=True,id=ca69b639-25df-404d-9907-6e2a17d556c9,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca69b639-25') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_vif [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:94:41,bridge_name='br-int',has_traffic_filtering=True,id=ca69b639-25df-404d-9907-6e2a17d556c9,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca69b639-25') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca69b639-25, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:04:23 user nova-compute[73052]: INFO os_vif [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:94:41,bridge_name='br-int',has_traffic_filtering=True,id=ca69b639-25df-404d-9907-6e2a17d556c9,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca69b639-25')
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmjzkDKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:04:23 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:04:23 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=24.942276000976562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cb49cf-159e-497c-ae96-ce52bf6fe342]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[98655e18-b8c9-4267-9fc6-e552575a85a1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:04:23 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:04:23 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:04:23 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:04:23 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:04:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:04:23 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:04:23 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:04:23 user nova-compute[73052]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 (non-flash)
Aug 26 15:04:23 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:04:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a0188f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084'): ({'sdg'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Removing single pathed devices sdg {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6634c283-3411-42ea-ab57-d230b974c517]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Applying migration context for instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f as it has an incoming, in-progress migration b57bb496-8ee0-4ddf-948e-716cd04cb7a8. Migration status is finished {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 15:04:23 user nova-compute[73052]: INFO nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating resource usage from migration b57bb496-8ee0-4ddf-948e-716cd04cb7a8
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ad8354-19f6-4f62-b22a-29bf059ad4b5]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flushing IO for device /dev/sdg {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2938e7e8-aae0-451d-aa19-7384ddba21ca]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f15dddfa-46f0-44d7-92cd-d6191d722670 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Migration b57bb496-8ee0-4ddf-948e-716cd04cb7a8 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a65223-9312-4ce7-9ea8-3fd2248678e5]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] SCSI volumes sdg have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84eb50a-c12d-4092-8047-e215947b298d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[68597a56-1f8e-48ce-854b-4f5357c09ae5]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084, portal: 172.16.0.220,3260]
Aug 26 15:04:23 user nova-compute[73052]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084, portal: 172.16.0.220,3260] successful.
Aug 26 15:04:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310aaf44-72dc-44c6-b7eb-df6a07ae3084 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc5cf0-e4c2-4e6b-a6a7-1e0a552e2bc2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== disconnect_volume: return (328ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:04:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Deleting instance files /opt/stack/data/nova/instances/f15dddfa-46f0-44d7-92cd-d6191d722670_del
Aug 26 15:04:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Deletion of /opt/stack/data/nova/instances/f15dddfa-46f0-44d7-92cd-d6191d722670_del complete
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:04:23 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:24 user nova-compute[73052]: INFO nova.compute.manager [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Took 1.81 seconds to destroy the instance on the hypervisor.
Aug 26 15:04:24 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-vif-unplugged-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] Acquiring lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] No waiting events found dispatching network-vif-unplugged-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-vif-unplugged-ca69b639-25df-404d-9907-6e2a17d556c9 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] Acquiring lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] No waiting events found dispatching network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:24 user nova-compute[73052]: WARNING nova.compute.manager [req-4d8253a4-30e0-4b12-8155-7e8e83d78f13 req-d2ee5708-ebbe-4af5-983c-802e04b0fc3c service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received unexpected event network-vif-plugged-ca69b639-25df-404d-9907-6e2a17d556c9 for instance with vm_state active and task_state deleting.
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:04:24 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Took 0.51 seconds to deallocate network for instance.
Aug 26 15:04:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-3882520a-4907-445b-b9f1-651c1917cf74 req-53d87032-c394-4637-a03e-75e2ee717c64 service nova] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Received event network-vif-deleted-ca69b639-25df-404d-9907-6e2a17d556c9 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:25 user nova-compute[73052]: INFO nova.compute.manager [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Took 0.84 seconds to detach 1 volumes for instance.
Aug 26 15:04:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:25 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:04:25 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:04:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:25 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Deleted allocations for instance f15dddfa-46f0-44d7-92cd-d6191d722670
Aug 26 15:04:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b88b0056-cb06-45f6-ac2e-3d4da9c0b2a6 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "f15dddfa-46f0-44d7-92cd-d6191d722670" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.635s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:04:27 user nova-compute[73052]: INFO nova.compute.manager [None req-d754f18a-0830-4a5e-b037-e4652df34e61 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Unrescuing
Aug 26 15:04:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d754f18a-0830-4a5e-b037-e4652df34e61 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:04:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d754f18a-0830-4a5e-b037-e4652df34e61 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquired lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:04:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d754f18a-0830-4a5e-b037-e4652df34e61 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d754f18a-0830-4a5e-b037-e4652df34e61 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating instance_info_cache with network_info: [{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d754f18a-0830-4a5e-b037-e4652df34e61 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Releasing lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d754f18a-0830-4a5e-b037-e4652df34e61 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'flavor' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-e016121d-6f67-4a01-af5b-6605681f1303 req-f46c2475-bd7b-46ce-a931-339d9fa2d012 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e016121d-6f67-4a01-af5b-6605681f1303 req-f46c2475-bd7b-46ce-a931-339d9fa2d012 service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e016121d-6f67-4a01-af5b-6605681f1303 req-f46c2475-bd7b-46ce-a931-339d9fa2d012 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e016121d-6f67-4a01-af5b-6605681f1303 req-f46c2475-bd7b-46ce-a931-339d9fa2d012 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-e016121d-6f67-4a01-af5b-6605681f1303 req-f46c2475-bd7b-46ce-a931-339d9fa2d012 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:28 user nova-compute[73052]: WARNING nova.compute.manager [req-e016121d-6f67-4a01-af5b-6605681f1303 req-f46c2475-bd7b-46ce-a931-339d9fa2d012 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state rescued and task_state unrescuing.
Aug 26 15:04:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance destroyed successfully.
Aug 26 15:04:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-a945f74a-1682-4112-ad17-d46b2cfef9ea req-331af31f-3b11-480d-a556-93604d8ae8b9 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a945f74a-1682-4112-ad17-d46b2cfef9ea req-331af31f-3b11-480d-a556-93604d8ae8b9 service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a945f74a-1682-4112-ad17-d46b2cfef9ea req-331af31f-3b11-480d-a556-93604d8ae8b9 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-a945f74a-1682-4112-ad17-d46b2cfef9ea req-331af31f-3b11-480d-a556-93604d8ae8b9 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG nova.compute.manager [req-a945f74a-1682-4112-ad17-d46b2cfef9ea req-331af31f-3b11-480d-a556-93604d8ae8b9 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:30 user nova-compute[73052]: WARNING nova.compute.manager [req-a945f74a-1682-4112-ad17-d46b2cfef9ea req-331af31f-3b11-480d-a556-93604d8ae8b9 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state rescued and task_state unrescuing.
Aug 26 15:04:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for 8089746e-24d8-4792-a97b-62193a2ad808 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062272.7095158, 8089746e-24d8-4792-a97b-62193a2ad808 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:04:32 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] VM Resumed (Lifecycle Event)
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d754f18a-0830-4a5e-b037-e4652df34e61 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:04:32 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062272.7108848, 8089746e-24d8-4792-a97b-62193a2ad808 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:04:32 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] VM Started (Lifecycle Event)
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:32 user nova-compute[73052]: WARNING nova.compute.manager [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state active and task_state None.
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:32 user nova-compute[73052]: WARNING nova.compute.manager [req-de5c177c-9f6a-4fff-bd7a-1a83950f458b req-fe3f1046-b870-4594-a5fe-eb9ea3a8eb3e service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state active and task_state None.
Aug 26 15:04:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:04:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:34 user nova-compute[73052]: INFO nova.compute.manager [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Detaching volume 529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9
Aug 26 15:04:34 user nova-compute[73052]: INFO nova.virt.block_device [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Attempting to driver detach volume 529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 from mountpoint /dev/vdb
Aug 26 15:04:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Attempting to detach device vdb from instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:04:35 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:04:35 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 15:04:35 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:04:35 user nova-compute[73052]:   <serial>529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9</serial>
Aug 26 15:04:35 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 15:04:35 user nova-compute[73052]: </disk>
Aug 26 15:04:35 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:04:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully detached device vdb from instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af from the persistent domain config.
Aug 26 15:04:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:04:35 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:04:35 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 15:04:35 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:04:35 user nova-compute[73052]:   <serial>529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9</serial>
Aug 26 15:04:35 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 15:04:35 user nova-compute[73052]: </disk>
Aug 26 15:04:35 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693062275.465878, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:04:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully detached device vdb from instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af from the live domain config.
Aug 26 15:04:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVBnAPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:04:35 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adfe5cf-03a9-4de4-a05d-049e7a588405]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ea9656-ecfb-4707-bd03-ff25bfe259a9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:04:35 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:04:35 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:04:35 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:04:35 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:04:35 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:04:35 user nova-compute[73052]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 (non-flash)
Aug 26 15:04:35 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:04:35 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7f1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffd8dc9-4c04-4cf5-ac87-5a2f24a3bdd3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c19b1c-2449-41ef-99da-32c14cae5ca1]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[00320622-e7e8-4c19-a5d8-9d726ef8506f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaa11ab-193f-4b3f-9283-c8d222ae6b64]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f19ad0-8b12-42e5-ac58-bab0775cdc20]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d88d6-0d86-4611-91a1-aa133b925b0e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260]
Aug 26 15:04:35 user nova-compute[73052]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9, portal: 172.16.0.220,3260] successful.
Aug 26 15:04:35 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:529bbb33-fc3b-4ac6-ad22-4a5bb1aa02c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b176126b-bea8-447b-a335-5e937136b0e3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== disconnect_volume: return (303ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:04:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:04:36 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:04:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d219d184-cb6d-4dbf-844c-f3a3f421b97a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d06d895d-9a52-4e06-8429-92cebcaa3746 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d06d895d-9a52-4e06-8429-92cebcaa3746 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d06d895d-9a52-4e06-8429-92cebcaa3746 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d06d895d-9a52-4e06-8429-92cebcaa3746 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73052) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d06d895d-9a52-4e06-8429-92cebcaa3746 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-62231586-1aac-492c-a2b5-003f2fea14e8 req-52f0e9a4-f75a-45f4-9cee-74a9fee00b17 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62231586-1aac-492c-a2b5-003f2fea14e8 req-52f0e9a4-f75a-45f4-9cee-74a9fee00b17 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62231586-1aac-492c-a2b5-003f2fea14e8 req-52f0e9a4-f75a-45f4-9cee-74a9fee00b17 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-62231586-1aac-492c-a2b5-003f2fea14e8 req-52f0e9a4-f75a-45f4-9cee-74a9fee00b17 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-62231586-1aac-492c-a2b5-003f2fea14e8 req-52f0e9a4-f75a-45f4-9cee-74a9fee00b17 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:37 user nova-compute[73052]: WARNING nova.compute.manager [req-62231586-1aac-492c-a2b5-003f2fea14e8 req-52f0e9a4-f75a-45f4-9cee-74a9fee00b17 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state active and task_state powering-off.
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062263.0728164, f15dddfa-46f0-44d7-92cd-d6191d722670 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:04:38 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] VM Stopped (Lifecycle Event)
Aug 26 15:04:38 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance destroyed successfully.
Aug 26 15:04:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d06d895d-9a52-4e06-8429-92cebcaa3746 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-921eb79b-37b2-4ca9-a52a-7b78bc066708 None None] [instance: f15dddfa-46f0-44d7-92cd-d6191d722670] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d06d895d-9a52-4e06-8429-92cebcaa3746 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.902s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:39 user nova-compute[73052]: WARNING nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state None.
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:39 user nova-compute[73052]: WARNING nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state None.
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:39 user nova-compute[73052]: WARNING nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state None.
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:39 user nova-compute[73052]: WARNING nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state None.
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:39 user nova-compute[73052]: DEBUG nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:39 user nova-compute[73052]: WARNING nova.compute.manager [req-2ffea9f2-b7ca-4f58-ad48-4fa4aeb2b241 req-cba1753f-3f33-4476-9cc7-5fcb6099fce2 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state None.
Aug 26 15:04:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-591a583b-51c2-45a0-abe3-af386c9881df req-4b0f6040-b7a2-44a3-b56e-59f79a0563b2 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-changed-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-591a583b-51c2-45a0-abe3-af386c9881df req-4b0f6040-b7a2-44a3-b56e-59f79a0563b2 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Refreshing instance network info cache due to event network-changed-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-591a583b-51c2-45a0-abe3-af386c9881df req-4b0f6040-b7a2-44a3-b56e-59f79a0563b2 service nova] Acquiring lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-591a583b-51c2-45a0-abe3-af386c9881df req-4b0f6040-b7a2-44a3-b56e-59f79a0563b2 service nova] Acquired lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG nova.network.neutron [req-591a583b-51c2-45a0-abe3-af386c9881df req-4b0f6040-b7a2-44a3-b56e-59f79a0563b2 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Refreshing network info cache for port 7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:43 user nova-compute[73052]: INFO nova.compute.manager [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Terminating instance
Aug 26 15:04:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-63048b9c-8194-4831-b17d-410519a6396c req-3d9fcb2a-3dba-4e67-adab-e498d13828ab service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-vif-unplugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-63048b9c-8194-4831-b17d-410519a6396c req-3d9fcb2a-3dba-4e67-adab-e498d13828ab service nova] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-63048b9c-8194-4831-b17d-410519a6396c req-3d9fcb2a-3dba-4e67-adab-e498d13828ab service nova] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-63048b9c-8194-4831-b17d-410519a6396c req-3d9fcb2a-3dba-4e67-adab-e498d13828ab service nova] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-63048b9c-8194-4831-b17d-410519a6396c req-3d9fcb2a-3dba-4e67-adab-e498d13828ab service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] No waiting events found dispatching network-vif-unplugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-63048b9c-8194-4831-b17d-410519a6396c req-3d9fcb2a-3dba-4e67-adab-e498d13828ab service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-vif-unplugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.network.neutron [req-591a583b-51c2-45a0-abe3-af386c9881df req-4b0f6040-b7a2-44a3-b56e-59f79a0563b2 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updated VIF entry in instance network info cache for port 7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.network.neutron [req-591a583b-51c2-45a0-abe3-af386c9881df req-4b0f6040-b7a2-44a3-b56e-59f79a0563b2 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updating instance_info_cache with network_info: [{"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-591a583b-51c2-45a0-abe3-af386c9881df req-4b0f6040-b7a2-44a3-b56e-59f79a0563b2 service nova] Releasing lock "refresh_cache-de1ab010-f0e3-48c7-bc42-b2bb5746cc13" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:04:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Instance destroyed successfully.
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lazy-loading 'resources' on Instance uuid de1ab010-f0e3-48c7-bc42-b2bb5746cc13 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1910020289',display_name='tempest-TestStampPattern-server-1910020289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1910020289',id=35,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQexKIMfesKSv2hoelfaNzG2QIHClVDFpvVqLXF9gD62XnTHDVnS3avo8uiqbd9zSMsB18mkPPWxAFIuiGViQSleqODN9ZqAbPTDcng8pgHyinnPi9agAubqw/jrXpO7g==',key_name='tempest-TestStampPattern-1713822412',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:57:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8dfbc7f8018b4fd29aa4a2f246a85c11',ramdisk_id='',reservation_id='r-gdupajo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1398027688',owner_user_name='tempest-TestStampPattern-1398027688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:00:35Z,user_data=None,user_id='d2625163eb644872b43a7914dcca366b',uuid=de1ab010-f0e3-48c7-bc42-b2bb5746cc13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converting VIF {"id": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "address": "fa:16:3e:eb:30:59", "network": {"id": "e4f866f4-0839-4579-b677-5db17b532105", "bridge": "br-int", "label": "tempest-TestStampPattern-952485884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfbc7f8018b4fd29aa4a2f246a85c11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fd0c3-fe", "ovs_interfaceid": "7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:30:59,bridge_name='br-int',has_traffic_filtering=True,id=7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fd0c3-fe') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG os_vif [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:30:59,bridge_name='br-int',has_traffic_filtering=True,id=7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fd0c3-fe') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d9fd0c3-fe, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:44 user nova-compute[73052]: INFO os_vif [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:30:59,bridge_name='br-int',has_traffic_filtering=True,id=7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0,network=Network(e4f866f4-0839-4579-b677-5db17b532105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fd0c3-fe')
Aug 26 15:04:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Deleting instance files /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13_del
Aug 26 15:04:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Deletion of /opt/stack/data/nova/instances/de1ab010-f0e3-48c7-bc42-b2bb5746cc13_del complete
Aug 26 15:04:44 user nova-compute[73052]: INFO nova.compute.manager [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 26 15:04:44 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:04:44 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:04:45 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:04:45 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Took 0.49 seconds to deallocate network for instance.
Aug 26 15:04:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:45 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:04:45 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:04:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:45 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Deleted allocations for instance de1ab010-f0e3-48c7-bc42-b2bb5746cc13
Aug 26 15:04:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d29aa244-b865-4c61-9007-db3fe8dcd54c tempest-TestStampPattern-1398027688 tempest-TestStampPattern-1398027688-project-member] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.942s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-38a99354-08eb-48b6-aa0d-c60e82c879f0 req-49b73643-ab18-4df1-948e-69f04ad03ab8 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38a99354-08eb-48b6-aa0d-c60e82c879f0 req-49b73643-ab18-4df1-948e-69f04ad03ab8 service nova] Acquiring lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38a99354-08eb-48b6-aa0d-c60e82c879f0 req-49b73643-ab18-4df1-948e-69f04ad03ab8 service nova] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-38a99354-08eb-48b6-aa0d-c60e82c879f0 req-49b73643-ab18-4df1-948e-69f04ad03ab8 service nova] Lock "de1ab010-f0e3-48c7-bc42-b2bb5746cc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-38a99354-08eb-48b6-aa0d-c60e82c879f0 req-49b73643-ab18-4df1-948e-69f04ad03ab8 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] No waiting events found dispatching network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:04:46 user nova-compute[73052]: WARNING nova.compute.manager [req-38a99354-08eb-48b6-aa0d-c60e82c879f0 req-49b73643-ab18-4df1-948e-69f04ad03ab8 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received unexpected event network-vif-plugged-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 for instance with vm_state deleted and task_state None.
Aug 26 15:04:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-38a99354-08eb-48b6-aa0d-c60e82c879f0 req-49b73643-ab18-4df1-948e-69f04ad03ab8 service nova] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Received event network-vif-deleted-7d9fd0c3-fe9a-4da4-916e-be7eae4faeb0 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:04:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:04:53 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062278.0875103, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:04:53 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Stopped (Lifecycle Event)
Aug 26 15:04:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6ad25fe6-d72b-4485-a413-e6bbb312cff8 None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:04:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6ad25fe6-d72b-4485-a413-e6bbb312cff8 None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:04:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:04:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Going to confirm migration 2 {{(pid=73052) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 15:04:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:04:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquired lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:04:56 user nova-compute[73052]: DEBUG nova.network.neutron [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:04:56 user nova-compute[73052]: DEBUG nova.objects.instance [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'info_cache' on Instance uuid e1161d8d-aa8a-4eff-888e-c7b699a2b76f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG nova.network.neutron [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating instance_info_cache with network_info: [{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Releasing lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG nova.objects.instance [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'migration_context' on Instance uuid e1161d8d-aa8a-4eff-888e-c7b699a2b76f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG nova.objects.base [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Object Instance<e1161d8d-aa8a-4eff-888e-c7b699a2b76f> lazy-loaded attributes: info_cache,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:04:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.275s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:57 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Deleted allocation for migration b57bb496-8ee0-4ddf-948e-716cd04cb7a8
Aug 26 15:04:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40c760b8-cc77-43ac-8dd4-74a65b37809b tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.253s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:04:59 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062284.3822181, de1ab010-f0e3-48c7-bc42-b2bb5746cc13 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:04:59 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] VM Stopped (Lifecycle Event)
Aug 26 15:04:59 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b68dfba9-1ab4-47cf-b946-da956847977e None None] [instance: de1ab010-f0e3-48c7-bc42-b2bb5746cc13] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:04:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:05:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:11 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:05:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:05:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:05:11 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:05:12 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updating instance_info_cache with network_info: [{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:05:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:05:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:05:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:05:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:05:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:19 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:05:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:05:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:05:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:05:21 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:05:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:23 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:05:23 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8258MB free_disk=25.066078186035156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:05:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:05:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:05:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-81afab56-9a8a-4546-90a6-fc13ad9488e0 req-2dc8e67d-dfbb-44fc-874c-764cce483885 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-changed-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-81afab56-9a8a-4546-90a6-fc13ad9488e0 req-2dc8e67d-dfbb-44fc-874c-764cce483885 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Refreshing instance network info cache due to event network-changed-255a6abb-2603-4ac3-87cb-e7c030792899. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81afab56-9a8a-4546-90a6-fc13ad9488e0 req-2dc8e67d-dfbb-44fc-874c-764cce483885 service nova] Acquiring lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81afab56-9a8a-4546-90a6-fc13ad9488e0 req-2dc8e67d-dfbb-44fc-874c-764cce483885 service nova] Acquired lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG nova.network.neutron [req-81afab56-9a8a-4546-90a6-fc13ad9488e0 req-2dc8e67d-dfbb-44fc-874c-764cce483885 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Refreshing network info cache for port 255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:05:33 user nova-compute[73052]: INFO nova.compute.manager [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Terminating instance
Aug 26 15:05:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-c39cb85e-1646-44e5-b5f0-2f55e6386261 req-f59bbc1f-dfed-47f0-83b4-a9f267113d9e service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-vif-unplugged-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c39cb85e-1646-44e5-b5f0-2f55e6386261 req-f59bbc1f-dfed-47f0-83b4-a9f267113d9e service nova] Acquiring lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c39cb85e-1646-44e5-b5f0-2f55e6386261 req-f59bbc1f-dfed-47f0-83b4-a9f267113d9e service nova] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c39cb85e-1646-44e5-b5f0-2f55e6386261 req-f59bbc1f-dfed-47f0-83b4-a9f267113d9e service nova] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-c39cb85e-1646-44e5-b5f0-2f55e6386261 req-f59bbc1f-dfed-47f0-83b4-a9f267113d9e service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] No waiting events found dispatching network-vif-unplugged-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-c39cb85e-1646-44e5-b5f0-2f55e6386261 req-f59bbc1f-dfed-47f0-83b4-a9f267113d9e service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-vif-unplugged-255a6abb-2603-4ac3-87cb-e7c030792899 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.network.neutron [req-81afab56-9a8a-4546-90a6-fc13ad9488e0 req-2dc8e67d-dfbb-44fc-874c-764cce483885 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updated VIF entry in instance network info cache for port 255a6abb-2603-4ac3-87cb-e7c030792899. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.network.neutron [req-81afab56-9a8a-4546-90a6-fc13ad9488e0 req-2dc8e67d-dfbb-44fc-874c-764cce483885 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updating instance_info_cache with network_info: [{"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-81afab56-9a8a-4546-90a6-fc13ad9488e0 req-2dc8e67d-dfbb-44fc-874c-764cce483885 service nova] Releasing lock "refresh_cache-d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Instance destroyed successfully.
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.objects.instance [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lazy-loading 'resources' on Instance uuid d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1667280266',display_name='tempest-TestVolumeBootPattern-server-1667280266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1667280266',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQj7J9L7SaJ1PFZ43CTOLjZPHF4jK1zQAEqKqafHjo7luNN0f8myMDewvpWGKyxiQJ00HXAIAxoC+4XQcWvmTzylb+j/BMAu0fZFS+G3whKjnYNMp7Pfvavcs0a3wZFA==',key_name='tempest-TestVolumeBootPattern-1815581114',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e8ab154558a4521920e05921722db36',ramdisk_id='',reservation_id='r-b9t3ir4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-772605316',owner_user_name='tempest-TestVolumeBootPattern-772605316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:00:39Z,user_data=None,user_id='ce6cd78a2f7c407983d90a15ffb94967',uuid=d3fec0a1-6b07-4b0a-9cf1-11cd415a7830,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converting VIF {"id": "255a6abb-2603-4ac3-87cb-e7c030792899", "address": "fa:16:3e:42:6a:c4", "network": {"id": "969e8b6e-1219-4d5f-b7d6-88035912888c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1123175458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e8ab154558a4521920e05921722db36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255a6abb-26", "ovs_interfaceid": "255a6abb-2603-4ac3-87cb-e7c030792899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=255a6abb-2603-4ac3-87cb-e7c030792899,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255a6abb-26') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_vif [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=255a6abb-2603-4ac3-87cb-e7c030792899,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255a6abb-26') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap255a6abb-26, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:34 user nova-compute[73052]: INFO os_vif [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:6a:c4,bridge_name='br-int',has_traffic_filtering=True,id=255a6abb-2603-4ac3-87cb-e7c030792899,network=Network(969e8b6e-1219-4d5f-b7d6-88035912888c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255a6abb-26')
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlHjJTwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:05:34 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[440531bb-7463-4ba6-9b81-1d962e6d1ee2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5372386e-7d3c-4fb3-a703-2af812c8544b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:05:34 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:05:34 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:05:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 (non-flash)
Aug 26 15:05:34 user nova-compute[73052]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:05:34 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:05:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c579b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e714a-935b-4ced-9bcd-83e646bf7c11]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f206ec54-8484-4154-84cb-bc0887b8746b]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d9647-8d07-438c-9249-d2f0eae68eb0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c5b6d4-6952-437a-907a-a603a575a2db]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_88aabe13', '/dev/disk/by-id/scsi-1SCST_BIO88aabe13-1a0783732983e033', '/dev/disk/by-id/scsi-23161303738333733') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ebd71d-89c8-48f8-b193-4152e7556a76]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fb69db-022b-47bb-9924-ce7e8b10d1e4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5939d093-befb-4728-91a1-f320dc659953]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260]
Aug 26 15:05:34 user nova-compute[73052]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8, portal: 172.16.0.220,3260] successful.
Aug 26 15:05:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56e4216-7611-4b65-86aa-66c7e78c46d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5feec5-3a53-4dc3-93ca-beb2204e5572]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] <== disconnect_volume: return (296ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:05:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Deleting instance files /opt/stack/data/nova/instances/d3fec0a1-6b07-4b0a-9cf1-11cd415a7830_del
Aug 26 15:05:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Deletion of /opt/stack/data/nova/instances/d3fec0a1-6b07-4b0a-9cf1-11cd415a7830_del complete
Aug 26 15:05:34 user nova-compute[73052]: INFO nova.compute.manager [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 26 15:05:34 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:05:34 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:05:35 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:05:35 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Took 0.56 seconds to deallocate network for instance.
Aug 26 15:05:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-4797ee8a-890c-458d-9d81-033a6be16c91 req-0dc23c94-1940-43d3-9213-d2af105e594b service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-vif-deleted-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:05:35 user nova-compute[73052]: INFO nova.compute.manager [req-4797ee8a-890c-458d-9d81-033a6be16c91 req-0dc23c94-1940-43d3-9213-d2af105e594b service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Neutron deleted interface 255a6abb-2603-4ac3-87cb-e7c030792899; detaching it from the instance and deleting it from the info cache
Aug 26 15:05:35 user nova-compute[73052]: DEBUG nova.network.neutron [req-4797ee8a-890c-458d-9d81-033a6be16c91 req-0dc23c94-1940-43d3-9213-d2af105e594b service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:05:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-4797ee8a-890c-458d-9d81-033a6be16c91 req-0dc23c94-1940-43d3-9213-d2af105e594b service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Detach interface failed, port_id=255a6abb-2603-4ac3-87cb-e7c030792899, reason: Instance d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-56cac3bb-2a12-4487-935e-5f9751bd545f req-10796d07-585e-4dc2-a6e8-a1bb9a078411 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received event network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-56cac3bb-2a12-4487-935e-5f9751bd545f req-10796d07-585e-4dc2-a6e8-a1bb9a078411 service nova] Acquiring lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-56cac3bb-2a12-4487-935e-5f9751bd545f req-10796d07-585e-4dc2-a6e8-a1bb9a078411 service nova] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-56cac3bb-2a12-4487-935e-5f9751bd545f req-10796d07-585e-4dc2-a6e8-a1bb9a078411 service nova] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-56cac3bb-2a12-4487-935e-5f9751bd545f req-10796d07-585e-4dc2-a6e8-a1bb9a078411 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] No waiting events found dispatching network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:05:36 user nova-compute[73052]: WARNING nova.compute.manager [req-56cac3bb-2a12-4487-935e-5f9751bd545f req-10796d07-585e-4dc2-a6e8-a1bb9a078411 service nova] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Received unexpected event network-vif-plugged-255a6abb-2603-4ac3-87cb-e7c030792899 for instance with vm_state active and task_state deleting.
Aug 26 15:05:36 user nova-compute[73052]: INFO nova.compute.manager [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Took 0.92 seconds to detach 1 volumes for instance.
Aug 26 15:05:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:05:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:05:36 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Deleted allocations for instance d3fec0a1-6b07-4b0a-9cf1-11cd415a7830
Aug 26 15:05:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-a418d919-b178-4b2c-9e8d-2e2d3cf50355 tempest-TestVolumeBootPattern-772605316 tempest-TestVolumeBootPattern-772605316-project-member] Lock "d3fec0a1-6b07-4b0a-9cf1-11cd415a7830" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.168s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:05:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:49 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062334.5514336, d3fec0a1-6b07-4b0a-9cf1-11cd415a7830 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:05:49 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] VM Stopped (Lifecycle Event)
Aug 26 15:05:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7adbaa3d-593f-42c3-a121-16c8bffa773b None None] [instance: d3fec0a1-6b07-4b0a-9cf1-11cd415a7830] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:05:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:05:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:05:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:06:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:06:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:06:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:06:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:06:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:06:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating instance_info_cache with network_info: [{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:06:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:06:20 user nova-compute[73052]: INFO nova.compute.claims [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Claim successful on node user
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:06:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.policy [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57f5f67238404fb9954260ad90a0a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7051da8614456b9334b146fa3581fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:06:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Creating image(s)
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "/opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "/opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:20 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk 1073741824" returned: 0 in 0.061s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Successfully created port: 643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.230s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Cannot resize image /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Ensure instance console log exists: /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Successfully updated port: 643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquired lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-42c3a084-565a-4bac-8535-5a51a7337080 req-da1922db-e852-4b0f-8f06-dc0efd6d1299 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received event network-changed-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.compute.manager [req-42c3a084-565a-4bac-8535-5a51a7337080 req-da1922db-e852-4b0f-8f06-dc0efd6d1299 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Refreshing instance network info cache due to event network-changed-643da605-04c7-40ff-9de7-c5307f9efcaa. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-42c3a084-565a-4bac-8535-5a51a7337080 req-da1922db-e852-4b0f-8f06-dc0efd6d1299 service nova] Acquiring lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Updating instance_info_cache with network_info: [{"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Releasing lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Instance network_info: |[{"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-42c3a084-565a-4bac-8535-5a51a7337080 req-da1922db-e852-4b0f-8f06-dc0efd6d1299 service nova] Acquired lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.neutron [req-42c3a084-565a-4bac-8535-5a51a7337080 req-da1922db-e852-4b0f-8f06-dc0efd6d1299 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Refreshing network info cache for port 643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Start _get_guest_xml network_info=[{"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:06:22 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:06:22 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1122506762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1122506762',id=44,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-ryn9zl1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:06:21Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=dd55bbdc-8b92-462e-b8ee-b391314ac20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:6a:33,bridge_name='br-int',has_traffic_filtering=True,id=643da605-04c7-40ff-9de7-c5307f9efcaa,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643da605-04') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.objects.instance [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'pci_devices' on Instance uuid dd55bbdc-8b92-462e-b8ee-b391314ac20c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:06:22 user nova-compute[73052]:   <uuid>dd55bbdc-8b92-462e-b8ee-b391314ac20c</uuid>
Aug 26 15:06:22 user nova-compute[73052]:   <name>instance-0000002c</name>
Aug 26 15:06:22 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:06:22 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:06:22 user nova-compute[73052]:   <metadata>
Aug 26 15:06:22 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:06:22 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:06:22 user nova-compute[73052]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1122506762</nova:name>
Aug 26 15:06:22 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:06:22</nova:creationTime>
Aug 26 15:06:22 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:06:22 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:06:22 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:06:22 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:06:22 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:06:22 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:06:22 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:06:22 user nova-compute[73052]:       <nova:owner>
Aug 26 15:06:22 user nova-compute[73052]:         <nova:user uuid="57f5f67238404fb9954260ad90a0a96d">tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member</nova:user>
Aug 26 15:06:22 user nova-compute[73052]:         <nova:project uuid="fe7051da8614456b9334b146fa3581fd">tempest-ServerBootFromVolumeStableRescueTest-505611186</nova:project>
Aug 26 15:06:22 user nova-compute[73052]:       </nova:owner>
Aug 26 15:06:22 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:06:22 user nova-compute[73052]:       <nova:ports>
Aug 26 15:06:22 user nova-compute[73052]:         <nova:port uuid="643da605-04c7-40ff-9de7-c5307f9efcaa">
Aug 26 15:06:22 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 15:06:22 user nova-compute[73052]:         </nova:port>
Aug 26 15:06:22 user nova-compute[73052]:       </nova:ports>
Aug 26 15:06:22 user nova-compute[73052]:     </nova:instance>
Aug 26 15:06:22 user nova-compute[73052]:   </metadata>
Aug 26 15:06:22 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:06:22 user nova-compute[73052]:     <system>
Aug 26 15:06:22 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:06:22 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:06:22 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:06:22 user nova-compute[73052]:       <entry name="serial">dd55bbdc-8b92-462e-b8ee-b391314ac20c</entry>
Aug 26 15:06:22 user nova-compute[73052]:       <entry name="uuid">dd55bbdc-8b92-462e-b8ee-b391314ac20c</entry>
Aug 26 15:06:22 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:06:22 user nova-compute[73052]:     </system>
Aug 26 15:06:22 user nova-compute[73052]:   </sysinfo>
Aug 26 15:06:22 user nova-compute[73052]:   <os>
Aug 26 15:06:22 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:06:22 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:06:22 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:06:22 user nova-compute[73052]:   </os>
Aug 26 15:06:22 user nova-compute[73052]:   <features>
Aug 26 15:06:22 user nova-compute[73052]:     <acpi/>
Aug 26 15:06:22 user nova-compute[73052]:     <apic/>
Aug 26 15:06:22 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:06:22 user nova-compute[73052]:   </features>
Aug 26 15:06:22 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:06:22 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:06:22 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:06:22 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:06:22 user nova-compute[73052]:   </clock>
Aug 26 15:06:22 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:06:22 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:06:22 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:06:22 user nova-compute[73052]:   </cpu>
Aug 26 15:06:22 user nova-compute[73052]:   <devices>
Aug 26 15:06:22 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:06:22 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:06:22 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk"/>
Aug 26 15:06:22 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:06:22 user nova-compute[73052]:     </disk>
Aug 26 15:06:22 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:06:22 user nova-compute[73052]:       <mac address="fa:16:3e:80:6a:33"/>
Aug 26 15:06:22 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:06:22 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:06:22 user nova-compute[73052]:       <target dev="tap643da605-04"/>
Aug 26 15:06:22 user nova-compute[73052]:     </interface>
Aug 26 15:06:22 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:06:22 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/console.log" append="off"/>
Aug 26 15:06:22 user nova-compute[73052]:     </serial>
Aug 26 15:06:22 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:06:22 user nova-compute[73052]:     <video>
Aug 26 15:06:22 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:06:22 user nova-compute[73052]:     </video>
Aug 26 15:06:22 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:06:22 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:06:22 user nova-compute[73052]:     </rng>
Aug 26 15:06:22 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:06:22 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:06:22 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:06:22 user nova-compute[73052]:     </memballoon>
Aug 26 15:06:22 user nova-compute[73052]:   </devices>
Aug 26 15:06:22 user nova-compute[73052]: </domain>
Aug 26 15:06:22 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1122506762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1122506762',id=44,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-ryn9zl1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:06:21Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=dd55bbdc-8b92-462e-b8ee-b391314ac20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:6a:33,bridge_name='br-int',has_traffic_filtering=True,id=643da605-04c7-40ff-9de7-c5307f9efcaa,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643da605-04') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG os_vif [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:6a:33,bridge_name='br-int',has_traffic_filtering=True,id=643da605-04c7-40ff-9de7-c5307f9efcaa,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643da605-04') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap643da605-04, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap643da605-04, col_values=(('external_ids', {'iface-id': '643da605-04c7-40ff-9de7-c5307f9efcaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:6a:33', 'vm-uuid': 'dd55bbdc-8b92-462e-b8ee-b391314ac20c'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:22 user nova-compute[73052]: INFO os_vif [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:6a:33,bridge_name='br-int',has_traffic_filtering=True,id=643da605-04c7-40ff-9de7-c5307f9efcaa,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643da605-04')
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No VIF found with MAC fa:16:3e:80:6a:33, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:06:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:23 user nova-compute[73052]: DEBUG nova.network.neutron [req-42c3a084-565a-4bac-8535-5a51a7337080 req-da1922db-e852-4b0f-8f06-dc0efd6d1299 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Updated VIF entry in instance network info cache for port 643da605-04c7-40ff-9de7-c5307f9efcaa. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:06:23 user nova-compute[73052]: DEBUG nova.network.neutron [req-42c3a084-565a-4bac-8535-5a51a7337080 req-da1922db-e852-4b0f-8f06-dc0efd6d1299 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Updating instance_info_cache with network_info: [{"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:06:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-42c3a084-565a-4bac-8535-5a51a7337080 req-da1922db-e852-4b0f-8f06-dc0efd6d1299 service nova] Releasing lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-c6823b68-5d08-4f44-ae48-f06c9264ffdc req-d3dce74b-95dc-4627-9f6d-c81c07dc6b3a service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received event network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c6823b68-5d08-4f44-ae48-f06c9264ffdc req-d3dce74b-95dc-4627-9f6d-c81c07dc6b3a service nova] Acquiring lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c6823b68-5d08-4f44-ae48-f06c9264ffdc req-d3dce74b-95dc-4627-9f6d-c81c07dc6b3a service nova] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c6823b68-5d08-4f44-ae48-f06c9264ffdc req-d3dce74b-95dc-4627-9f6d-c81c07dc6b3a service nova] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-c6823b68-5d08-4f44-ae48-f06c9264ffdc req-d3dce74b-95dc-4627-9f6d-c81c07dc6b3a service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] No waiting events found dispatching network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:06:24 user nova-compute[73052]: WARNING nova.compute.manager [req-c6823b68-5d08-4f44-ae48-f06c9264ffdc req-d3dce74b-95dc-4627-9f6d-c81c07dc6b3a service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received unexpected event network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa for instance with vm_state building and task_state spawning.
Aug 26 15:06:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:06:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=25.055191040039062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062386.364648, dd55bbdc-8b92-462e-b8ee-b391314ac20c => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:06:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] VM Resumed (Lifecycle Event)
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:06:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Instance spawned successfully.
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:06:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062386.3690565, dd55bbdc-8b92-462e-b8ee-b391314ac20c => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:06:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] VM Started (Lifecycle Event)
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:06:26 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:06:26 user nova-compute[73052]: INFO nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:06:26 user nova-compute[73052]: INFO nova.compute.manager [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Took 6.43 seconds to build instance.
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb70-c3e4-4630-b980-e77a8b6af552 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.523s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-b4520344-e18f-4653-9aaa-b07673b77745 req-339826e4-f608-491b-9260-e0a6910e0216 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received event network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b4520344-e18f-4653-9aaa-b07673b77745 req-339826e4-f608-491b-9260-e0a6910e0216 service nova] Acquiring lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b4520344-e18f-4653-9aaa-b07673b77745 req-339826e4-f608-491b-9260-e0a6910e0216 service nova] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b4520344-e18f-4653-9aaa-b07673b77745 req-339826e4-f608-491b-9260-e0a6910e0216 service nova] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-b4520344-e18f-4653-9aaa-b07673b77745 req-339826e4-f608-491b-9260-e0a6910e0216 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] No waiting events found dispatching network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:06:26 user nova-compute[73052]: WARNING nova.compute.manager [req-b4520344-e18f-4653-9aaa-b07673b77745 req-339826e4-f608-491b-9260-e0a6910e0216 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received unexpected event network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa for instance with vm_state active and task_state None.
Aug 26 15:06:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquired lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'info_cache' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.objects.base [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updating instance_info_cache with network_info: [{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Releasing lock "refresh_cache-9bdcc677-a1c4-4fc9-87b9-28a9babf53af" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:06:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance destroyed successfully.
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'resources' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.objects.base [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG os_vif [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:06:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a404e9c-e1, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:06:29 user nova-compute[73052]: INFO os_vif [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1')
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Start _get_guest_xml network_info=[{"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'numa_topology' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:06:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:06:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:06:29 user nova-compute[73052]:   <uuid>9bdcc677-a1c4-4fc9-87b9-28a9babf53af</uuid>
Aug 26 15:06:29 user nova-compute[73052]:   <name>instance-00000025</name>
Aug 26 15:06:29 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:06:29 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:06:29 user nova-compute[73052]:   <metadata>
Aug 26 15:06:29 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:06:29 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:06:29 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeTestJSON-server-1311299839</nova:name>
Aug 26 15:06:29 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:06:29</nova:creationTime>
Aug 26 15:06:29 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:06:29 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:06:29 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:06:29 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:06:29 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:06:29 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:06:29 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:06:29 user nova-compute[73052]:       <nova:owner>
Aug 26 15:06:29 user nova-compute[73052]:         <nova:user uuid="8677e9414700404ea8a9cf07cae299b2">tempest-AttachVolumeTestJSON-68461294-project-member</nova:user>
Aug 26 15:06:29 user nova-compute[73052]:         <nova:project uuid="f05c842807aa4763b4e319c8098ba064">tempest-AttachVolumeTestJSON-68461294</nova:project>
Aug 26 15:06:29 user nova-compute[73052]:       </nova:owner>
Aug 26 15:06:29 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:06:29 user nova-compute[73052]:       <nova:ports>
Aug 26 15:06:29 user nova-compute[73052]:         <nova:port uuid="3a404e9c-e1ad-4c05-a706-f39084d8a5df">
Aug 26 15:06:29 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 15:06:29 user nova-compute[73052]:         </nova:port>
Aug 26 15:06:29 user nova-compute[73052]:       </nova:ports>
Aug 26 15:06:29 user nova-compute[73052]:     </nova:instance>
Aug 26 15:06:29 user nova-compute[73052]:   </metadata>
Aug 26 15:06:29 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:06:29 user nova-compute[73052]:     <system>
Aug 26 15:06:29 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:06:29 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:06:29 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:06:29 user nova-compute[73052]:       <entry name="serial">9bdcc677-a1c4-4fc9-87b9-28a9babf53af</entry>
Aug 26 15:06:29 user nova-compute[73052]:       <entry name="uuid">9bdcc677-a1c4-4fc9-87b9-28a9babf53af</entry>
Aug 26 15:06:29 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:06:29 user nova-compute[73052]:     </system>
Aug 26 15:06:29 user nova-compute[73052]:   </sysinfo>
Aug 26 15:06:29 user nova-compute[73052]:   <os>
Aug 26 15:06:29 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:06:29 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:06:29 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:06:29 user nova-compute[73052]:   </os>
Aug 26 15:06:29 user nova-compute[73052]:   <features>
Aug 26 15:06:29 user nova-compute[73052]:     <acpi/>
Aug 26 15:06:29 user nova-compute[73052]:     <apic/>
Aug 26 15:06:29 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:06:29 user nova-compute[73052]:   </features>
Aug 26 15:06:29 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:06:29 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:06:29 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:06:29 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:06:29 user nova-compute[73052]:   </clock>
Aug 26 15:06:29 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:06:29 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:06:29 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:06:29 user nova-compute[73052]:   </cpu>
Aug 26 15:06:29 user nova-compute[73052]:   <devices>
Aug 26 15:06:29 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:06:29 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:06:29 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk"/>
Aug 26 15:06:29 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:06:29 user nova-compute[73052]:     </disk>
Aug 26 15:06:29 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:06:29 user nova-compute[73052]:       <mac address="fa:16:3e:e8:36:41"/>
Aug 26 15:06:29 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:06:29 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:06:29 user nova-compute[73052]:       <target dev="tap3a404e9c-e1"/>
Aug 26 15:06:29 user nova-compute[73052]:     </interface>
Aug 26 15:06:29 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:06:29 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/console.log" append="off"/>
Aug 26 15:06:29 user nova-compute[73052]:     </serial>
Aug 26 15:06:29 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:06:29 user nova-compute[73052]:     <video>
Aug 26 15:06:29 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:06:29 user nova-compute[73052]:     </video>
Aug 26 15:06:29 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:06:29 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:06:29 user nova-compute[73052]:     </rng>
Aug 26 15:06:29 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:06:29 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:06:29 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:06:29 user nova-compute[73052]:     </memballoon>
Aug 26 15:06:29 user nova-compute[73052]:   </devices>
Aug 26 15:06:29 user nova-compute[73052]: </domain>
Aug 26 15:06:29 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Cannot resize image /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'migration_context' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Object Instance<9bdcc677-a1c4-4fc9-87b9-28a9babf53af> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG os_vif [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:06:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a404e9c-e1, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a404e9c-e1, col_values=(('external_ids', {'iface-id': '3a404e9c-e1ad-4c05-a706-f39084d8a5df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:36:41', 'vm-uuid': '9bdcc677-a1c4-4fc9-87b9-28a9babf53af'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:30 user nova-compute[73052]: INFO os_vif [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1')
Aug 26 15:06:30 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:06:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:06:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-08872ecc-f9c7-4af4-9df9-61bc5d32e2a4 req-b30f8933-a78f-4182-977d-ce9d2c1ee6d3 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:06:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-08872ecc-f9c7-4af4-9df9-61bc5d32e2a4 req-b30f8933-a78f-4182-977d-ce9d2c1ee6d3 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-08872ecc-f9c7-4af4-9df9-61bc5d32e2a4 req-b30f8933-a78f-4182-977d-ce9d2c1ee6d3 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-08872ecc-f9c7-4af4-9df9-61bc5d32e2a4 req-b30f8933-a78f-4182-977d-ce9d2c1ee6d3 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-08872ecc-f9c7-4af4-9df9-61bc5d32e2a4 req-b30f8933-a78f-4182-977d-ce9d2c1ee6d3 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:06:31 user nova-compute[73052]: WARNING nova.compute.manager [req-08872ecc-f9c7-4af4-9df9-61bc5d32e2a4 req-b30f8933-a78f-4182-977d-ce9d2c1ee6d3 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state powering-on.
Aug 26 15:06:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-06fc3279-3edd-4b00-9ae3-5c7e3a8e3793 req-e2201cb6-16f8-4950-a1b3-5bf5bbe25c07 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-06fc3279-3edd-4b00-9ae3-5c7e3a8e3793 req-e2201cb6-16f8-4950-a1b3-5bf5bbe25c07 service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-06fc3279-3edd-4b00-9ae3-5c7e3a8e3793 req-e2201cb6-16f8-4950-a1b3-5bf5bbe25c07 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-06fc3279-3edd-4b00-9ae3-5c7e3a8e3793 req-e2201cb6-16f8-4950-a1b3-5bf5bbe25c07 service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-06fc3279-3edd-4b00-9ae3-5c7e3a8e3793 req-e2201cb6-16f8-4950-a1b3-5bf5bbe25c07 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:06:33 user nova-compute[73052]: WARNING nova.compute.manager [req-06fc3279-3edd-4b00-9ae3-5c7e3a8e3793 req-e2201cb6-16f8-4950-a1b3-5bf5bbe25c07 service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state stopped and task_state powering-on.
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062393.856516, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:06:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Resumed (Lifecycle Event)
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:06:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance rebooted successfully.
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-14ed6e0e-5a1b-47ba-8261-dab29aa23a5a tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:06:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062393.8591847, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:06:33 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Started (Lifecycle Event)
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:06:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:06:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:06:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:47 user nova-compute[73052]: INFO nova.compute.manager [None req-78253cb7-3243-4b22-8914-64f34e0538bc tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Get console output
Aug 26 15:06:47 user nova-compute[73052]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 15:06:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 33ec579e-3ce9-46e3-9e06-ca91fb20571f {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 35013e14-c22c-439a-923f-61b1b98ce6b8 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid e1161d8d-aa8a-4eff-888e-c7b699a2b76f {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid dd55bbdc-8b92-462e-b8ee-b391314ac20c {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "8089746e-24d8-4792-a97b-62193a2ad808" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "8089746e-24d8-4792-a97b-62193a2ad808" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:06:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:07:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:07:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:07:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:07:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:07:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating instance_info_cache with network_info: [{"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:07:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-e1161d8d-aa8a-4eff-888e-c7b699a2b76f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:07:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:07:13 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:07:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:07:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:07:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:07:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:23 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:07:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:07:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:07:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:07:23 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:07:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:07:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=25.02381134033203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:07:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:07:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:07:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:07:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:07:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:07:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:07:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:07:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:07:48 user nova-compute[73052]: INFO nova.compute.manager [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Terminating instance
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-cf6812eb-4b08-4c5c-aacc-c47fc5e6ae0f req-179b60d6-b029-4716-a08a-2e1ea346bb7f service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-unplugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf6812eb-4b08-4c5c-aacc-c47fc5e6ae0f req-179b60d6-b029-4716-a08a-2e1ea346bb7f service nova] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf6812eb-4b08-4c5c-aacc-c47fc5e6ae0f req-179b60d6-b029-4716-a08a-2e1ea346bb7f service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cf6812eb-4b08-4c5c-aacc-c47fc5e6ae0f req-179b60d6-b029-4716-a08a-2e1ea346bb7f service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-cf6812eb-4b08-4c5c-aacc-c47fc5e6ae0f req-179b60d6-b029-4716-a08a-2e1ea346bb7f service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] No waiting events found dispatching network-vif-unplugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.compute.manager [req-cf6812eb-4b08-4c5c-aacc-c47fc5e6ae0f req-179b60d6-b029-4716-a08a-2e1ea346bb7f service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-unplugged-3d5216f0-f889-4824-b93f-2bccee3eba4d for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Instance destroyed successfully.
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'resources' on Instance uuid e1161d8d-aa8a-4eff-888e-c7b699a2b76f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-767395342',display_name='tempest-ServerActionsTestOtherA-server-767395342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-767395342',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:03:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-t3a4pj50',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=e1161d8d-aa8a-4eff-888e-c7b699a2b76f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "address": "fa:16:3e:ba:bf:ca", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5216f0-f8", "ovs_interfaceid": "3d5216f0-f889-4824-b93f-2bccee3eba4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG os_vif [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d5216f0-f8, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:07:48 user nova-compute[73052]: INFO os_vif [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d5216f0-f889-4824-b93f-2bccee3eba4d,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5216f0-f8')
Aug 26 15:07:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okOuSIjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:07:48 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:07:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:07:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccedf461-a509-4f83-8059-e2b39d6a9300]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7645477-f549-44d2-8847-c06865773a3c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:07:49 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:07:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:07:49 user nova-compute[73052]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 (non-flash)
Aug 26 15:07:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01f2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bb46e5-fd0a-434d-a4bd-b9558702e071]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd0fa8d-574d-4bce-aa2a-dbc6bef5e81c]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5142a0e2-95d9-4ed3-b169-af5196af4947]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4168034d-1c5b-4dcc-b34f-a558ef00e153]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_450bc455', '/dev/disk/by-id/scsi-1SCST_BIO450bc455-7e9debdd665b69cd', '/dev/disk/by-id/scsi-23765396465626464') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d633ff4f-0e6e-4e91-a462-1b4aa92d1ad5]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e8b41e-0a96-4a0a-8acb-4dadbc0459c7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[669d552e-6cf1-4abf-993e-a24535a6c37e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260]
Aug 26 15:07:49 user nova-compute[73052]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9, portal: 172.16.0.220,3260] successful.
Aug 26 15:07:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc0155b-369c-4c7b-9480-f11c829e00f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a26759e-abb1-43e4-b67b-a6870c30869f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] <== disconnect_volume: return (280ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:07:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Deleting instance files /opt/stack/data/nova/instances/e1161d8d-aa8a-4eff-888e-c7b699a2b76f_del
Aug 26 15:07:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Deletion of /opt/stack/data/nova/instances/e1161d8d-aa8a-4eff-888e-c7b699a2b76f_del complete
Aug 26 15:07:49 user nova-compute[73052]: INFO nova.compute.manager [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 26 15:07:49 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:07:49 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:07:50 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:07:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-94b1c4dc-975c-424f-b721-2a38d6b2a3b6 req-0265662a-2eef-44ed-8675-1172ab8d4ac8 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:07:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-94b1c4dc-975c-424f-b721-2a38d6b2a3b6 req-0265662a-2eef-44ed-8675-1172ab8d4ac8 service nova] Acquiring lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:07:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-94b1c4dc-975c-424f-b721-2a38d6b2a3b6 req-0265662a-2eef-44ed-8675-1172ab8d4ac8 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:07:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-94b1c4dc-975c-424f-b721-2a38d6b2a3b6 req-0265662a-2eef-44ed-8675-1172ab8d4ac8 service nova] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:07:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-94b1c4dc-975c-424f-b721-2a38d6b2a3b6 req-0265662a-2eef-44ed-8675-1172ab8d4ac8 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] No waiting events found dispatching network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:07:50 user nova-compute[73052]: WARNING nova.compute.manager [req-94b1c4dc-975c-424f-b721-2a38d6b2a3b6 req-0265662a-2eef-44ed-8675-1172ab8d4ac8 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received unexpected event network-vif-plugged-3d5216f0-f889-4824-b93f-2bccee3eba4d for instance with vm_state active and task_state deleting.
Aug 26 15:07:50 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Took 1.23 seconds to deallocate network for instance.
Aug 26 15:07:51 user nova-compute[73052]: INFO nova.compute.manager [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Took 0.83 seconds to detach 1 volumes for instance.
Aug 26 15:07:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Deleting volume: edc0155b-369c-4c7b-9480-f11c829e00f9 {{(pid=73052) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 15:07:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:07:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:07:51 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:07:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:07:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:07:51 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Deleted allocations for instance e1161d8d-aa8a-4eff-888e-c7b699a2b76f
Aug 26 15:07:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b609ee9d-24f4-42fd-b546-13c57b3f0f4d tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "e1161d8d-aa8a-4eff-888e-c7b699a2b76f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.878s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:07:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-6f6c883a-4481-45af-a238-5f0164b91275 req-0f8f19bd-5142-4926-bd4b-ad5cdf371ad4 service nova] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Received event network-vif-deleted-3d5216f0-f889-4824-b93f-2bccee3eba4d {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:07:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:07:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:03 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062468.9384704, e1161d8d-aa8a-4eff-888e-c7b699a2b76f => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:08:03 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] VM Stopped (Lifecycle Event)
Aug 26 15:08:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3e2a2913-92d9-4933-98bc-ce6ca4a8c299 None None] [instance: e1161d8d-aa8a-4eff-888e-c7b699a2b76f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:08:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:08:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:08:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:08:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:08:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:08:11 user nova-compute[73052]: INFO nova.compute.manager [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] instance snapshotting
Aug 26 15:08:11 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Beginning live snapshot process
Aug 26 15:08:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json -f qcow2 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json -f qcow2 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.166s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqrrp9qej/a1196fec057a4d8ea475bcb8ca9f284e.delta 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqrrp9qej/a1196fec057a4d8ea475bcb8ca9f284e.delta 1073741824" returned: 0 in 0.049s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:12 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 15:08:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 15:08:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73052) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 15:08:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 15:08:13 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 15:08:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqrrp9qej/a1196fec057a4d8ea475bcb8ca9f284e.delta /opt/stack/data/nova/instances/snapshots/tmpqrrp9qej/a1196fec057a4d8ea475bcb8ca9f284e {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqrrp9qej/a1196fec057a4d8ea475bcb8ca9f284e.delta /opt/stack/data/nova/instances/snapshots/tmpqrrp9qej/a1196fec057a4d8ea475bcb8ca9f284e" returned: 0 in 0.541s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Snapshot extracted, beginning image upload
Aug 26 15:08:16 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Snapshot image upload complete
Aug 26 15:08:16 user nova-compute[73052]: INFO nova.compute.manager [None req-967bf8d6-d336-4969-906e-ed1bd0b857f6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Took 4.85 seconds to snapshot the instance on the hypervisor.
Aug 26 15:08:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:08:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:08:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:08:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:08:17 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:08:17 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 33ec579e-3ce9-46e3-9e06-ca91fb20571f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [{"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-33ec579e-3ce9-46e3-9e06-ca91fb20571f" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:19 user nova-compute[73052]: INFO nova.compute.manager [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Terminating instance
Aug 26 15:08:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-601f4b1f-69b4-45cc-8e84-06a557527da0 req-9b4f52e2-b10c-40c1-a04f-a612936bd74c service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-601f4b1f-69b4-45cc-8e84-06a557527da0 req-9b4f52e2-b10c-40c1-a04f-a612936bd74c service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-601f4b1f-69b4-45cc-8e84-06a557527da0 req-9b4f52e2-b10c-40c1-a04f-a612936bd74c service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-601f4b1f-69b4-45cc-8e84-06a557527da0 req-9b4f52e2-b10c-40c1-a04f-a612936bd74c service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-601f4b1f-69b4-45cc-8e84-06a557527da0 req-9b4f52e2-b10c-40c1-a04f-a612936bd74c service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:08:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-601f4b1f-69b4-45cc-8e84-06a557527da0 req-9b4f52e2-b10c-40c1-a04f-a612936bd74c service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-unplugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:08:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Instance destroyed successfully.
Aug 26 15:08:20 user nova-compute[73052]: DEBUG nova.objects.instance [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'resources' on Instance uuid 9bdcc677-a1c4-4fc9-87b9-28a9babf53af {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1311299839',display_name='tempest-AttachVolumeTestJSON-server-1311299839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1311299839',id=37,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8FzYFKmA69llCUltgtSb3e7vcSvTW/ZGGZN95XWVLA6HQ5iqXswE0pzNsjooiKACjLUo5aF9NXmB5dmGiEMFxsPPLAUpUsuNAvv2hG9wdAhkKZUCQz2ejPB8WMbwTEIg==',key_name='tempest-keypair-2000220974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-caq41fbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=9bdcc677-a1c4-4fc9-87b9-28a9babf53af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "address": "fa:16:3e:e8:36:41", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a404e9c-e1", "ovs_interfaceid": "3a404e9c-e1ad-4c05-a706-f39084d8a5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG os_vif [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a404e9c-e1, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:08:20 user nova-compute[73052]: INFO os_vif [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:36:41,bridge_name='br-int',has_traffic_filtering=True,id=3a404e9c-e1ad-4c05-a706-f39084d8a5df,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a404e9c-e1')
Aug 26 15:08:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Deleting instance files /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af_del
Aug 26 15:08:20 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Deletion of /opt/stack/data/nova/instances/9bdcc677-a1c4-4fc9-87b9-28a9babf53af_del complete
Aug 26 15:08:20 user nova-compute[73052]: INFO nova.compute.manager [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 26 15:08:20 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:08:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:08:21 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Took 1.06 seconds to deallocate network for instance.
Aug 26 15:08:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-58aea1ed-a210-4109-9f22-297919b54769 req-6d7f1527-5a90-4bd9-a4d4-9dc6d87d5cec service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-deleted-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:21 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Deleted allocations for instance 9bdcc677-a1c4-4fc9-87b9-28a9babf53af
Aug 26 15:08:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-84f6f1c1-8eeb-41b6-a8c4-1dea410e980d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-b6ef71fe-aba1-4875-ba94-39130c76d490 req-7a11cf2c-f5d2-42f9-9281-b6e62f7ded7d service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b6ef71fe-aba1-4875-ba94-39130c76d490 req-7a11cf2c-f5d2-42f9-9281-b6e62f7ded7d service nova] Acquiring lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b6ef71fe-aba1-4875-ba94-39130c76d490 req-7a11cf2c-f5d2-42f9-9281-b6e62f7ded7d service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b6ef71fe-aba1-4875-ba94-39130c76d490 req-7a11cf2c-f5d2-42f9-9281-b6e62f7ded7d service nova] Lock "9bdcc677-a1c4-4fc9-87b9-28a9babf53af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:21 user nova-compute[73052]: DEBUG nova.compute.manager [req-b6ef71fe-aba1-4875-ba94-39130c76d490 req-7a11cf2c-f5d2-42f9-9281-b6e62f7ded7d service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] No waiting events found dispatching network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:08:21 user nova-compute[73052]: WARNING nova.compute.manager [req-b6ef71fe-aba1-4875-ba94-39130c76d490 req-7a11cf2c-f5d2-42f9-9281-b6e62f7ded7d service nova] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Received unexpected event network-vif-plugged-3a404e9c-e1ad-4c05-a706-f39084d8a5df for instance with vm_state deleted and task_state None.
Aug 26 15:08:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:24 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:08:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:08:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:08:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=25.00171661376953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:08:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:08:30 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:08:35 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062500.0337186, 9bdcc677-a1c4-4fc9-87b9-28a9babf53af => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:08:35 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] VM Stopped (Lifecycle Event)
Aug 26 15:08:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-f09b8cb4-2687-45fb-9515-91e5951825fd None None] [instance: 9bdcc677-a1c4-4fc9-87b9-28a9babf53af] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:08:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:08:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:08:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:08:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:08:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:45 user nova-compute[73052]: INFO nova.compute.manager [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Terminating instance
Aug 26 15:08:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-ccb61874-6d68-4443-a577-16dea5ddbed4 req-4eb427e9-3380-4249-b8c8-80274d00bf2d service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-vif-unplugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ccb61874-6d68-4443-a577-16dea5ddbed4 req-4eb427e9-3380-4249-b8c8-80274d00bf2d service nova] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ccb61874-6d68-4443-a577-16dea5ddbed4 req-4eb427e9-3380-4249-b8c8-80274d00bf2d service nova] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ccb61874-6d68-4443-a577-16dea5ddbed4 req-4eb427e9-3380-4249-b8c8-80274d00bf2d service nova] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-ccb61874-6d68-4443-a577-16dea5ddbed4 req-4eb427e9-3380-4249-b8c8-80274d00bf2d service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] No waiting events found dispatching network-vif-unplugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:08:45 user nova-compute[73052]: DEBUG nova.compute.manager [req-ccb61874-6d68-4443-a577-16dea5ddbed4 req-4eb427e9-3380-4249-b8c8-80274d00bf2d service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-vif-unplugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Instance destroyed successfully.
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.objects.instance [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lazy-loading 'resources' on Instance uuid 33ec579e-3ce9-46e3-9e06-ca91fb20571f {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1580223323',display_name='tempest-ServerActionsTestOtherA-server-1580223323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1580223323',id=24,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt65zxNPdTqR0LE8yVcBQsvga/uHxwlp5xqLDPtvAaeOOju/rh7dZPdJyZzyw+SNk6MKfAhFuLAY+dOH822buIb2WUsjneNitcUigtUEp4Z7RyveFO9bv7uX4t6Ejl0eQ==',key_name='tempest-keypair-138465173',keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb3fc9a170804f0ebfa2dde967e3fec2',ramdisk_id='',reservation_id='r-q1kmm4wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1682869035',owner_user_name='tempest-ServerActionsTestOtherA-1682869035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5061033588974e7ead6c7abc8a47308e',uuid=33ec579e-3ce9-46e3-9e06-ca91fb20571f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converting VIF {"id": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "address": "fa:16:3e:7d:8d:33", "network": {"id": "b40dc815-e21a-4f0b-8481-c7a42b72dcef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-163085203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3fc9a170804f0ebfa2dde967e3fec2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap008d9525-e9", "ovs_interfaceid": "008d9525-e93d-40f5-ac18-aa9696c0fd7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=008d9525-e93d-40f5-ac18-aa9696c0fd7a,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008d9525-e9') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG os_vif [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=008d9525-e93d-40f5-ac18-aa9696c0fd7a,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008d9525-e9') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap008d9525-e9, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:08:46 user nova-compute[73052]: INFO os_vif [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=008d9525-e93d-40f5-ac18-aa9696c0fd7a,network=Network(b40dc815-e21a-4f0b-8481-c7a42b72dcef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap008d9525-e9')
Aug 26 15:08:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Deleting instance files /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f_del
Aug 26 15:08:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Deletion of /opt/stack/data/nova/instances/33ec579e-3ce9-46e3-9e06-ca91fb20571f_del complete
Aug 26 15:08:46 user nova-compute[73052]: INFO nova.compute.manager [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 15:08:46 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:08:46 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Took 0.44 seconds to deallocate network for instance.
Aug 26 15:08:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:08:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:46 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Deleted allocations for instance 33ec579e-3ce9-46e3-9e06-ca91fb20571f
Aug 26 15:08:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eedb4470-04db-47f8-bdab-4b6419884e34 tempest-ServerActionsTestOtherA-1682869035 tempest-ServerActionsTestOtherA-1682869035-project-member] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.725s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-3ac9ae0e-de7f-49f1-abe3-9d029e9ae65e req-91148f4b-bd40-4332-b48e-8d60693946f7 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:08:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3ac9ae0e-de7f-49f1-abe3-9d029e9ae65e req-91148f4b-bd40-4332-b48e-8d60693946f7 service nova] Acquiring lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:08:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3ac9ae0e-de7f-49f1-abe3-9d029e9ae65e req-91148f4b-bd40-4332-b48e-8d60693946f7 service nova] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:08:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3ac9ae0e-de7f-49f1-abe3-9d029e9ae65e req-91148f4b-bd40-4332-b48e-8d60693946f7 service nova] Lock "33ec579e-3ce9-46e3-9e06-ca91fb20571f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:08:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-3ac9ae0e-de7f-49f1-abe3-9d029e9ae65e req-91148f4b-bd40-4332-b48e-8d60693946f7 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] No waiting events found dispatching network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:08:47 user nova-compute[73052]: WARNING nova.compute.manager [req-3ac9ae0e-de7f-49f1-abe3-9d029e9ae65e req-91148f4b-bd40-4332-b48e-8d60693946f7 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received unexpected event network-vif-plugged-008d9525-e93d-40f5-ac18-aa9696c0fd7a for instance with vm_state deleted and task_state None.
Aug 26 15:08:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-3ac9ae0e-de7f-49f1-abe3-9d029e9ae65e req-91148f4b-bd40-4332-b48e-8d60693946f7 service nova] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Received event network-vif-deleted-008d9525-e93d-40f5-ac18-aa9696c0fd7a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:08:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:08:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:09:01 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062526.0611503, 33ec579e-3ce9-46e3-9e06-ca91fb20571f => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:09:01 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] VM Stopped (Lifecycle Event)
Aug 26 15:09:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-741c7719-581e-4d02-8d91-ffbcf24a2618 None None] [instance: 33ec579e-3ce9-46e3-9e06-ca91fb20571f] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:09:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:09:13 user nova-compute[73052]: INFO nova.compute.claims [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Claim successful on node user
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.network.neutron [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:09:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.policy [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8677e9414700404ea8a9cf07cae299b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f05c842807aa4763b4e319c8098ba064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:09:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Creating image(s)
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "/opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "/opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk 1073741824" returned: 0 in 0.051s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG nova.network.neutron [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Successfully created port: 22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Cannot resize image /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Ensure instance console log exists: /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Successfully updated port: 22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquired lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-0fccfad0-e30e-4b57-8eae-8728fbce5141 req-f9a644fd-e716-469a-8b6e-1db86b4fe063 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received event network-changed-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-0fccfad0-e30e-4b57-8eae-8728fbce5141 req-f9a644fd-e716-469a-8b6e-1db86b4fe063 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Refreshing instance network info cache due to event network-changed-22d636cd-96ba-46d8-b68a-8025430c4f20. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0fccfad0-e30e-4b57-8eae-8728fbce5141 req-f9a644fd-e716-469a-8b6e-1db86b4fe063 service nova] Acquiring lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Updating instance_info_cache with network_info: [{"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Releasing lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Instance network_info: |[{"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0fccfad0-e30e-4b57-8eae-8728fbce5141 req-f9a644fd-e716-469a-8b6e-1db86b4fe063 service nova] Acquired lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-0fccfad0-e30e-4b57-8eae-8728fbce5141 req-f9a644fd-e716-469a-8b6e-1db86b4fe063 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Refreshing network info cache for port 22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Start _get_guest_xml network_info=[{"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:09:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:09:15 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2088320085',display_name='tempest-AttachVolumeTestJSON-server-2088320085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2088320085',id=45,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO1xjK629PmoUlnNqrYjnD8+L0gN5d6s/z+HLuMuAiK++5ueCpFfgBFnr1SfXoGCAJVylxOpUivB53HgfIBHGdF8+wO/T5IwER1xMeeHZGoiE2uWsjo3xy8ZjM5mhDwHg==',key_name='tempest-keypair-1025338331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-z00tba40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=d3df938e-03c3-43ab-8dfd-73b056704ff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=22d636cd-96ba-46d8-b68a-8025430c4f20,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d636cd-96') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.objects.instance [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'pci_devices' on Instance uuid d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:09:15 user nova-compute[73052]:   <uuid>d3df938e-03c3-43ab-8dfd-73b056704ff4</uuid>
Aug 26 15:09:15 user nova-compute[73052]:   <name>instance-0000002d</name>
Aug 26 15:09:15 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:09:15 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:09:15 user nova-compute[73052]:   <metadata>
Aug 26 15:09:15 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:09:15 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:09:15 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeTestJSON-server-2088320085</nova:name>
Aug 26 15:09:15 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:09:15</nova:creationTime>
Aug 26 15:09:15 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:09:15 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:09:15 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:09:15 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:09:15 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:09:15 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:09:15 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:09:15 user nova-compute[73052]:       <nova:owner>
Aug 26 15:09:15 user nova-compute[73052]:         <nova:user uuid="8677e9414700404ea8a9cf07cae299b2">tempest-AttachVolumeTestJSON-68461294-project-member</nova:user>
Aug 26 15:09:15 user nova-compute[73052]:         <nova:project uuid="f05c842807aa4763b4e319c8098ba064">tempest-AttachVolumeTestJSON-68461294</nova:project>
Aug 26 15:09:15 user nova-compute[73052]:       </nova:owner>
Aug 26 15:09:15 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:09:15 user nova-compute[73052]:       <nova:ports>
Aug 26 15:09:15 user nova-compute[73052]:         <nova:port uuid="22d636cd-96ba-46d8-b68a-8025430c4f20">
Aug 26 15:09:15 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 15:09:15 user nova-compute[73052]:         </nova:port>
Aug 26 15:09:15 user nova-compute[73052]:       </nova:ports>
Aug 26 15:09:15 user nova-compute[73052]:     </nova:instance>
Aug 26 15:09:15 user nova-compute[73052]:   </metadata>
Aug 26 15:09:15 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:09:15 user nova-compute[73052]:     <system>
Aug 26 15:09:15 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:09:15 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:09:15 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:09:15 user nova-compute[73052]:       <entry name="serial">d3df938e-03c3-43ab-8dfd-73b056704ff4</entry>
Aug 26 15:09:15 user nova-compute[73052]:       <entry name="uuid">d3df938e-03c3-43ab-8dfd-73b056704ff4</entry>
Aug 26 15:09:15 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:09:15 user nova-compute[73052]:     </system>
Aug 26 15:09:15 user nova-compute[73052]:   </sysinfo>
Aug 26 15:09:15 user nova-compute[73052]:   <os>
Aug 26 15:09:15 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:09:15 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:09:15 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:09:15 user nova-compute[73052]:   </os>
Aug 26 15:09:15 user nova-compute[73052]:   <features>
Aug 26 15:09:15 user nova-compute[73052]:     <acpi/>
Aug 26 15:09:15 user nova-compute[73052]:     <apic/>
Aug 26 15:09:15 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:09:15 user nova-compute[73052]:   </features>
Aug 26 15:09:15 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:09:15 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:09:15 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:09:15 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:09:15 user nova-compute[73052]:   </clock>
Aug 26 15:09:15 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:09:15 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:09:15 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:09:15 user nova-compute[73052]:   </cpu>
Aug 26 15:09:15 user nova-compute[73052]:   <devices>
Aug 26 15:09:15 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:09:15 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:09:15 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk"/>
Aug 26 15:09:15 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:09:15 user nova-compute[73052]:     </disk>
Aug 26 15:09:15 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:09:15 user nova-compute[73052]:       <mac address="fa:16:3e:62:e0:fe"/>
Aug 26 15:09:15 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:09:15 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:09:15 user nova-compute[73052]:       <target dev="tap22d636cd-96"/>
Aug 26 15:09:15 user nova-compute[73052]:     </interface>
Aug 26 15:09:15 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:09:15 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/console.log" append="off"/>
Aug 26 15:09:15 user nova-compute[73052]:     </serial>
Aug 26 15:09:15 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:09:15 user nova-compute[73052]:     <video>
Aug 26 15:09:15 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:09:15 user nova-compute[73052]:     </video>
Aug 26 15:09:15 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:09:15 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:09:15 user nova-compute[73052]:     </rng>
Aug 26 15:09:15 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:09:15 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:09:15 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:09:15 user nova-compute[73052]:     </memballoon>
Aug 26 15:09:15 user nova-compute[73052]:   </devices>
Aug 26 15:09:15 user nova-compute[73052]: </domain>
Aug 26 15:09:15 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2088320085',display_name='tempest-AttachVolumeTestJSON-server-2088320085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2088320085',id=45,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO1xjK629PmoUlnNqrYjnD8+L0gN5d6s/z+HLuMuAiK++5ueCpFfgBFnr1SfXoGCAJVylxOpUivB53HgfIBHGdF8+wO/T5IwER1xMeeHZGoiE2uWsjo3xy8ZjM5mhDwHg==',key_name='tempest-keypair-1025338331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-z00tba40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=d3df938e-03c3-43ab-8dfd-73b056704ff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=22d636cd-96ba-46d8-b68a-8025430c4f20,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d636cd-96') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG os_vif [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=22d636cd-96ba-46d8-b68a-8025430c4f20,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d636cd-96') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22d636cd-96, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22d636cd-96, col_values=(('external_ids', {'iface-id': '22d636cd-96ba-46d8-b68a-8025430c4f20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:e0:fe', 'vm-uuid': 'd3df938e-03c3-43ab-8dfd-73b056704ff4'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:15 user nova-compute[73052]: INFO os_vif [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=22d636cd-96ba-46d8-b68a-8025430c4f20,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d636cd-96')
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No VIF found with MAC fa:16:3e:62:e0:fe, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-0fccfad0-e30e-4b57-8eae-8728fbce5141 req-f9a644fd-e716-469a-8b6e-1db86b4fe063 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Updated VIF entry in instance network info cache for port 22d636cd-96ba-46d8-b68a-8025430c4f20. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-0fccfad0-e30e-4b57-8eae-8728fbce5141 req-f9a644fd-e716-469a-8b6e-1db86b4fe063 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Updating instance_info_cache with network_info: [{"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0fccfad0-e30e-4b57-8eae-8728fbce5141 req-f9a644fd-e716-469a-8b6e-1db86b4fe063 service nova] Releasing lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:09:15 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-dd7be29e-adfd-4144-8ce4-d416abcb51d6 req-192394b1-a281-41eb-9ad6-4fef6b38a35f service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received event network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dd7be29e-adfd-4144-8ce4-d416abcb51d6 req-192394b1-a281-41eb-9ad6-4fef6b38a35f service nova] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dd7be29e-adfd-4144-8ce4-d416abcb51d6 req-192394b1-a281-41eb-9ad6-4fef6b38a35f service nova] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dd7be29e-adfd-4144-8ce4-d416abcb51d6 req-192394b1-a281-41eb-9ad6-4fef6b38a35f service nova] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-dd7be29e-adfd-4144-8ce4-d416abcb51d6 req-192394b1-a281-41eb-9ad6-4fef6b38a35f service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] No waiting events found dispatching network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:09:17 user nova-compute[73052]: WARNING nova.compute.manager [req-dd7be29e-adfd-4144-8ce4-d416abcb51d6 req-192394b1-a281-41eb-9ad6-4fef6b38a35f service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received unexpected event network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 for instance with vm_state building and task_state spawning.
Aug 26 15:09:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:09:18 user nova-compute[73052]: INFO nova.compute.claims [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Claim successful on node user
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:09:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:09:18 user nova-compute[73052]: INFO nova.virt.block_device [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Booting with volume-backed-image a9d03ca9-51ef-4843-bf03-544c5298003b at /dev/vda
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.policy [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57f5f67238404fb9954260ad90a0a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7051da8614456b9334b146fa3581fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062558.9252133, d3df938e-03c3-43ab-8dfd-73b056704ff4 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:09:18 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] VM Resumed (Lifecycle Event)
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:09:18 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Instance spawned successfully.
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:18 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:09:18 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062558.9262238, d3df938e-03c3-43ab-8dfd-73b056704ff4 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:09:18 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] VM Started (Lifecycle Event)
Aug 26 15:09:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:09:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:09:19 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:09:19 user nova-compute[73052]: INFO nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 26 15:09:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:09:19 user nova-compute[73052]: INFO nova.compute.manager [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Took 5.91 seconds to build instance.
Aug 26 15:09:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-c3a3eefd-fb72-4a27-9d33-eec5c599bb6d req-8aeefbb8-005c-4a17-b0ca-77e6942c35eb service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received event network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:09:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c3a3eefd-fb72-4a27-9d33-eec5c599bb6d req-8aeefbb8-005c-4a17-b0ca-77e6942c35eb service nova] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c3a3eefd-fb72-4a27-9d33-eec5c599bb6d req-8aeefbb8-005c-4a17-b0ca-77e6942c35eb service nova] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c3a3eefd-fb72-4a27-9d33-eec5c599bb6d req-8aeefbb8-005c-4a17-b0ca-77e6942c35eb service nova] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:19 user nova-compute[73052]: DEBUG nova.compute.manager [req-c3a3eefd-fb72-4a27-9d33-eec5c599bb6d req-8aeefbb8-005c-4a17-b0ca-77e6942c35eb service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] No waiting events found dispatching network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:09:19 user nova-compute[73052]: WARNING nova.compute.manager [req-c3a3eefd-fb72-4a27-9d33-eec5c599bb6d req-8aeefbb8-005c-4a17-b0ca-77e6942c35eb service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received unexpected event network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 for instance with vm_state active and task_state None.
Aug 26 15:09:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08575df8-09c1-47bb-8d50-ccafdbc9d094 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.008s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:19 user nova-compute[73052]: DEBUG nova.network.neutron [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Successfully created port: caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:09:19 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Successfully updated port: caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquired lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e0212c4-14e9-4ff6-8fdf-ad6714748883 req-69d11880-e87f-4f7d-8f56-ac9e0ccf7012 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-changed-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e0212c4-14e9-4ff6-8fdf-ad6714748883 req-69d11880-e87f-4f7d-8f56-ac9e0ccf7012 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Refreshing instance network info cache due to event network-changed-caaa3974-b551-4bc1-8374-53623ff22df7. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e0212c4-14e9-4ff6-8fdf-ad6714748883 req-69d11880-e87f-4f7d-8f56-ac9e0ccf7012 service nova] Acquiring lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Updating instance_info_cache with network_info: [{"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Releasing lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance network_info: |[{"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e0212c4-14e9-4ff6-8fdf-ad6714748883 req-69d11880-e87f-4f7d-8f56-ac9e0ccf7012 service nova] Acquired lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:09:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e0212c4-14e9-4ff6-8fdf-ad6714748883 req-69d11880-e87f-4f7d-8f56-ac9e0ccf7012 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Refreshing network info cache for port caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:09:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e0212c4-14e9-4ff6-8fdf-ad6714748883 req-69d11880-e87f-4f7d-8f56-ac9e0ccf7012 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Updated VIF entry in instance network info cache for port caaa3974-b551-4bc1-8374-53623ff22df7. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:09:21 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e0212c4-14e9-4ff6-8fdf-ad6714748883 req-69d11880-e87f-4f7d-8f56-ac9e0ccf7012 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Updating instance_info_cache with network_info: [{"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:09:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e0212c4-14e9-4ff6-8fdf-ad6714748883 req-69d11880-e87f-4f7d-8f56-ac9e0ccf7012 service nova] Releasing lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:09:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:09:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:24 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:09:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:09:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=25.026996612548828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d3df938e-03c3-43ab-8dfd-73b056704ff4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f4d8a634-b9c6-471d-89df-fadec635aa07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:09:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25b93bf-21da-4a10-8f46-5a2333474691]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[23778015-b106-4acc-bc35-07690e009fff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ad3e2c-93b1-4135-ba82-27d593b47f8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdee08d-ed2f-46ed-be22-21ddb7913773]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:09:29 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:09:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[00724c88-eb9a-47c8-a061-67709cc5874e]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG os_brick.utils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:09:29 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Updating existing volume attachment record: 9e977123-92e9-4692-8e91-5f9f64824cfd {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:09:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:09:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:09:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Creating image(s)
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Ensure instance console log exists: /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Start _get_guest_xml network_info=[{"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '9e977123-92e9-4692-8e91-5f9f64824cfd', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edaItkAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f4d8a634-b9c6-471d-89df-fadec635aa07', 'attached_at': '', 'detached_at': '', 'volume_id': '97967ade-d979-49e1-9d55-e5775eee1250', 'serial': '97967ade-d979-49e1-9d55-e5775eee1250'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:09:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:09:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:09:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edaItkAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:09:41 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:09:41 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:09:41 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[591e26fc-1aef-47ff-818b-13d9fadf4f6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:09:41 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62dc35f-24e1-4c17-a822-56bcb18d3383]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250] added
Aug 26 15:09:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a7ad37-0536-4dbc-aa2e-6f1665a3c638]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[812f7469-ffb0-45f0-9eb1-d7a8fc895757]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edaItkAT {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edaItkAT" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[504dc177-fe11-4244-9d0c-9ee7b413b2d3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edaItkAT'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa80190-fbb7-4a11-8883-c7d65493dffe]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7cd96d-30dc-43fb-b422-b5efa07065f8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:09:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:09:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84746b7-119b-4dee-be7a-9a9eb4e9baeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250, portal: 172.16.0.220,3260]
Aug 26 15:09:41 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250, portal: 172.16.0.220,3260] successful.
Aug 26 15:09:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3980b9b5-2de7-4684-9125-3ac83e522f35]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c711741-f2f0-4ba9-b28f-c509025bfc5a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:09:41 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:09:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:09:41 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:09:41 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1203f715-a645-4b38-8e9b-2ffc82ea5ec5]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:09:41 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edaItkAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23264303936363065', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264303936363065', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1856601229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1856601229',id=46,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-b5ksfpm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:09:19Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=f4d8a634-b9c6-471d-89df-fadec635aa07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:15:d2,bridge_name='br-int',has_traffic_filtering=True,id=caaa3974-b551-4bc1-8374-53623ff22df7,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa3974-b5') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.objects.instance [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'pci_devices' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:09:42 user nova-compute[73052]:   <uuid>f4d8a634-b9c6-471d-89df-fadec635aa07</uuid>
Aug 26 15:09:42 user nova-compute[73052]:   <name>instance-0000002e</name>
Aug 26 15:09:42 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:09:42 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:09:42 user nova-compute[73052]:   <metadata>
Aug 26 15:09:42 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:09:42 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:09:42 user nova-compute[73052]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1856601229</nova:name>
Aug 26 15:09:42 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:09:40</nova:creationTime>
Aug 26 15:09:42 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:09:42 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:09:42 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:09:42 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:09:42 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:09:42 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:09:42 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:09:42 user nova-compute[73052]:       <nova:owner>
Aug 26 15:09:42 user nova-compute[73052]:         <nova:user uuid="57f5f67238404fb9954260ad90a0a96d">tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member</nova:user>
Aug 26 15:09:42 user nova-compute[73052]:         <nova:project uuid="fe7051da8614456b9334b146fa3581fd">tempest-ServerBootFromVolumeStableRescueTest-505611186</nova:project>
Aug 26 15:09:42 user nova-compute[73052]:       </nova:owner>
Aug 26 15:09:42 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:09:42 user nova-compute[73052]:       <nova:ports>
Aug 26 15:09:42 user nova-compute[73052]:         <nova:port uuid="caaa3974-b551-4bc1-8374-53623ff22df7">
Aug 26 15:09:42 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 15:09:42 user nova-compute[73052]:         </nova:port>
Aug 26 15:09:42 user nova-compute[73052]:       </nova:ports>
Aug 26 15:09:42 user nova-compute[73052]:     </nova:instance>
Aug 26 15:09:42 user nova-compute[73052]:   </metadata>
Aug 26 15:09:42 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:09:42 user nova-compute[73052]:     <system>
Aug 26 15:09:42 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:09:42 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:09:42 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:09:42 user nova-compute[73052]:       <entry name="serial">f4d8a634-b9c6-471d-89df-fadec635aa07</entry>
Aug 26 15:09:42 user nova-compute[73052]:       <entry name="uuid">f4d8a634-b9c6-471d-89df-fadec635aa07</entry>
Aug 26 15:09:42 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:09:42 user nova-compute[73052]:     </system>
Aug 26 15:09:42 user nova-compute[73052]:   </sysinfo>
Aug 26 15:09:42 user nova-compute[73052]:   <os>
Aug 26 15:09:42 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:09:42 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:09:42 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:09:42 user nova-compute[73052]:   </os>
Aug 26 15:09:42 user nova-compute[73052]:   <features>
Aug 26 15:09:42 user nova-compute[73052]:     <acpi/>
Aug 26 15:09:42 user nova-compute[73052]:     <apic/>
Aug 26 15:09:42 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:09:42 user nova-compute[73052]:   </features>
Aug 26 15:09:42 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:09:42 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:09:42 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:09:42 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:09:42 user nova-compute[73052]:   </clock>
Aug 26 15:09:42 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:09:42 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:09:42 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:09:42 user nova-compute[73052]:   </cpu>
Aug 26 15:09:42 user nova-compute[73052]:   <devices>
Aug 26 15:09:42 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:09:42 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:09:42 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 15:09:42 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:09:42 user nova-compute[73052]:       <serial>97967ade-d979-49e1-9d55-e5775eee1250</serial>
Aug 26 15:09:42 user nova-compute[73052]:     </disk>
Aug 26 15:09:42 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:09:42 user nova-compute[73052]:       <mac address="fa:16:3e:1c:15:d2"/>
Aug 26 15:09:42 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:09:42 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:09:42 user nova-compute[73052]:       <target dev="tapcaaa3974-b5"/>
Aug 26 15:09:42 user nova-compute[73052]:     </interface>
Aug 26 15:09:42 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:09:42 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/console.log" append="off"/>
Aug 26 15:09:42 user nova-compute[73052]:     </serial>
Aug 26 15:09:42 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:09:42 user nova-compute[73052]:     <video>
Aug 26 15:09:42 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:09:42 user nova-compute[73052]:     </video>
Aug 26 15:09:42 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:09:42 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:09:42 user nova-compute[73052]:     </rng>
Aug 26 15:09:42 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:09:42 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:09:42 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:09:42 user nova-compute[73052]:     </memballoon>
Aug 26 15:09:42 user nova-compute[73052]:   </devices>
Aug 26 15:09:42 user nova-compute[73052]: </domain>
Aug 26 15:09:42 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1856601229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1856601229',id=46,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-b5ksfpm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:09:19Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=f4d8a634-b9c6-471d-89df-fadec635aa07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:15:d2,bridge_name='br-int',has_traffic_filtering=True,id=caaa3974-b551-4bc1-8374-53623ff22df7,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa3974-b5') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG os_vif [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:15:d2,bridge_name='br-int',has_traffic_filtering=True,id=caaa3974-b551-4bc1-8374-53623ff22df7,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa3974-b5') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcaaa3974-b5, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcaaa3974-b5, col_values=(('external_ids', {'iface-id': 'caaa3974-b551-4bc1-8374-53623ff22df7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:15:d2', 'vm-uuid': 'f4d8a634-b9c6-471d-89df-fadec635aa07'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:42 user nova-compute[73052]: INFO os_vif [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:15:d2,bridge_name='br-int',has_traffic_filtering=True,id=caaa3974-b551-4bc1-8374-53623ff22df7,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa3974-b5')
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:09:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No VIF found with MAC fa:16:3e:1c:15:d2, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:09:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-176dd040-c4fa-4dc0-9d66-e3295e504903 req-3c8bb91e-57af-4cc1-88bc-d375c32cddc3 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:09:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-176dd040-c4fa-4dc0-9d66-e3295e504903 req-3c8bb91e-57af-4cc1-88bc-d375c32cddc3 service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-176dd040-c4fa-4dc0-9d66-e3295e504903 req-3c8bb91e-57af-4cc1-88bc-d375c32cddc3 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-176dd040-c4fa-4dc0-9d66-e3295e504903 req-3c8bb91e-57af-4cc1-88bc-d375c32cddc3 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:43 user nova-compute[73052]: DEBUG nova.compute.manager [req-176dd040-c4fa-4dc0-9d66-e3295e504903 req-3c8bb91e-57af-4cc1-88bc-d375c32cddc3 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:09:43 user nova-compute[73052]: WARNING nova.compute.manager [req-176dd040-c4fa-4dc0-9d66-e3295e504903 req-3c8bb91e-57af-4cc1-88bc-d375c32cddc3 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state building and task_state spawning.
Aug 26 15:09:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062585.887333, f4d8a634-b9c6-471d-89df-fadec635aa07 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:09:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] VM Resumed (Lifecycle Event)
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:09:45 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance spawned successfully.
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:09:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062585.8909698, f4d8a634-b9c6-471d-89df-fadec635aa07 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:09:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] VM Started (Lifecycle Event)
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:09:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:09:45 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:09:45 user nova-compute[73052]: INFO nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 26 15:09:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:09:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-b2eabffa-ea8a-454f-bd7d-e0ef22cf0d73 req-4a22923a-5110-4824-97b9-4d18e249ca14 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:09:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b2eabffa-ea8a-454f-bd7d-e0ef22cf0d73 req-4a22923a-5110-4824-97b9-4d18e249ca14 service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:09:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b2eabffa-ea8a-454f-bd7d-e0ef22cf0d73 req-4a22923a-5110-4824-97b9-4d18e249ca14 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:09:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b2eabffa-ea8a-454f-bd7d-e0ef22cf0d73 req-4a22923a-5110-4824-97b9-4d18e249ca14 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-b2eabffa-ea8a-454f-bd7d-e0ef22cf0d73 req-4a22923a-5110-4824-97b9-4d18e249ca14 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:09:46 user nova-compute[73052]: WARNING nova.compute.manager [req-b2eabffa-ea8a-454f-bd7d-e0ef22cf0d73 req-4a22923a-5110-4824-97b9-4d18e249ca14 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state building and task_state spawning.
Aug 26 15:09:46 user nova-compute[73052]: INFO nova.compute.manager [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Took 27.68 seconds to build instance.
Aug 26 15:09:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-01b4221d-4b7f-4d1a-8221-394df8a1ade6 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.770s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:09:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:09:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:09:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:09:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:09:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:09:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:10:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating instance_info_cache with network_info: [{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:10:19 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:10:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:10:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:10:24 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:10:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:10:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:10:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:10:26 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8423MB free_disk=24.988567352294922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d3df938e-03c3-43ab-8dfd-73b056704ff4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f4d8a634-b9c6-471d-89df-fadec635aa07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:10:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:10:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:10:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:10:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:10:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:10:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:31 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:10:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:10:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:10:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:10:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:10:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:10:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:10:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:11:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:11:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:11:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:11:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:11:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:04 user nova-compute[73052]: DEBUG nova.compute.manager [req-897da10d-15d7-4cde-8796-65988352a89a req-fe453d06-2398-47d9-bdbd-f17cf0c15b38 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received event network-changed-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:11:04 user nova-compute[73052]: DEBUG nova.compute.manager [req-897da10d-15d7-4cde-8796-65988352a89a req-fe453d06-2398-47d9-bdbd-f17cf0c15b38 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Refreshing instance network info cache due to event network-changed-22d636cd-96ba-46d8-b68a-8025430c4f20. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:11:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-897da10d-15d7-4cde-8796-65988352a89a req-fe453d06-2398-47d9-bdbd-f17cf0c15b38 service nova] Acquiring lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:11:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-897da10d-15d7-4cde-8796-65988352a89a req-fe453d06-2398-47d9-bdbd-f17cf0c15b38 service nova] Acquired lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:11:04 user nova-compute[73052]: DEBUG nova.network.neutron [req-897da10d-15d7-4cde-8796-65988352a89a req-fe453d06-2398-47d9-bdbd-f17cf0c15b38 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Refreshing network info cache for port 22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:11:05 user nova-compute[73052]: DEBUG nova.network.neutron [req-897da10d-15d7-4cde-8796-65988352a89a req-fe453d06-2398-47d9-bdbd-f17cf0c15b38 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Updated VIF entry in instance network info cache for port 22d636cd-96ba-46d8-b68a-8025430c4f20. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:11:05 user nova-compute[73052]: DEBUG nova.network.neutron [req-897da10d-15d7-4cde-8796-65988352a89a req-fe453d06-2398-47d9-bdbd-f17cf0c15b38 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Updating instance_info_cache with network_info: [{"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:11:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-897da10d-15d7-4cde-8796-65988352a89a req-fe453d06-2398-47d9-bdbd-f17cf0c15b38 service nova] Releasing lock "refresh_cache-d3df938e-03c3-43ab-8dfd-73b056704ff4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:11:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:09 user nova-compute[73052]: INFO nova.compute.manager [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Rescuing
Aug 26 15:11:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:11:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquired lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:11:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:11:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Updating instance_info_cache with network_info: [{"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:11:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Releasing lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:11:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-fdbc06a1-a904-483a-b93d-40685bdb82a8 req-529b9689-7475-40f7-8145-6c930b8045ed service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fdbc06a1-a904-483a-b93d-40685bdb82a8 req-529b9689-7475-40f7-8145-6c930b8045ed service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fdbc06a1-a904-483a-b93d-40685bdb82a8 req-529b9689-7475-40f7-8145-6c930b8045ed service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fdbc06a1-a904-483a-b93d-40685bdb82a8 req-529b9689-7475-40f7-8145-6c930b8045ed service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-fdbc06a1-a904-483a-b93d-40685bdb82a8 req-529b9689-7475-40f7-8145-6c930b8045ed service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:11:10 user nova-compute[73052]: WARNING nova.compute.manager [req-fdbc06a1-a904-483a-b93d-40685bdb82a8 req-529b9689-7475-40f7-8145-6c930b8045ed service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state active and task_state rescuing.
Aug 26 15:11:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance destroyed successfully.
Aug 26 15:11:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Attempting a stable device rescue
Aug 26 15:11:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73052) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance directory exists: not creating {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 15:11:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Creating image(s)
Aug 26 15:11:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "/opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "/opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "835718c448fa65f96c746d3225dcf30b697cc88c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "835718c448fa65f96c746d3225dcf30b697cc88c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c.part --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c.part --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:11 user nova-compute[73052]: DEBUG nova.virt.images [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] 7ec715a6-dd7c-4b6b-b51a-ea7ea6dea2da was qcow2, converting to raw {{(pid=73052) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 15:11:11 user nova-compute[73052]: DEBUG nova.privsep.utils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73052) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 15:11:11 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c.part /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c.converted {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG nova.compute.manager [req-e8af9956-05fd-48d2-a237-0ff3f1ab54a3 req-ccdceb53-1067-41b9-90d8-363438ab5957 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e8af9956-05fd-48d2-a237-0ff3f1ab54a3 req-ccdceb53-1067-41b9-90d8-363438ab5957 service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e8af9956-05fd-48d2-a237-0ff3f1ab54a3 req-ccdceb53-1067-41b9-90d8-363438ab5957 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e8af9956-05fd-48d2-a237-0ff3f1ab54a3 req-ccdceb53-1067-41b9-90d8-363438ab5957 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG nova.compute.manager [req-e8af9956-05fd-48d2-a237-0ff3f1ab54a3 req-ccdceb53-1067-41b9-90d8-363438ab5957 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:11:12 user nova-compute[73052]: WARNING nova.compute.manager [req-e8af9956-05fd-48d2-a237-0ff3f1ab54a3 req-ccdceb53-1067-41b9-90d8-363438ab5957 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state active and task_state rescuing.
Aug 26 15:11:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c.part /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c.converted" returned: 0 in 0.566s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c.converted --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "835718c448fa65f96c746d3225dcf30b697cc88c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.119s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "835718c448fa65f96c746d3225dcf30b697cc88c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "835718c448fa65f96c746d3225dcf30b697cc88c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:12 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c,backing_fmt=raw /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c,backing_fmt=raw /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue" returned: 0 in 0.054s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "835718c448fa65f96c746d3225dcf30b697cc88c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'migration_context' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<f4d8a634-b9c6-471d-89df-fadec635aa07> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Start _get_guest_xml network_info=[{"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "vif_mac": "fa:16:3e:1c:15:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7ec715a6-dd7c-4b6b-b51a-ea7ea6dea2da', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '9e977123-92e9-4692-8e91-5f9f64824cfd', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edaItkAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f4d8a634-b9c6-471d-89df-fadec635aa07', 'attached_at': '', 'detached_at': '', 'volume_id': '97967ade-d979-49e1-9d55-e5775eee1250', 'serial': '97967ade-d979-49e1-9d55-e5775eee1250'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'resources' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.instance [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<f4d8a634-b9c6-471d-89df-fadec635aa07> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'numa_topology' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<f4d8a634-b9c6-471d-89df-fadec635aa07> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:11:13 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:11:13 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<f4d8a634-b9c6-471d-89df-fadec635aa07> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edaItkAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:11:13 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:11:13 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:11:13 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[575ca8c7-8bca-4a57-977b-aded13ae3d90]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = edaItkAT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 15:11:13 user nova-compute[73052]: node.name = iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250
Aug 26 15:11:13 user nova-compute[73052]: node.tpgt = -1
Aug 26 15:11:13 user nova-compute[73052]: node.startup = automatic
Aug 26 15:11:13 user nova-compute[73052]: node.leading_login = No
Aug 26 15:11:13 user nova-compute[73052]: iface.iscsi_ifacename = default
Aug 26 15:11:13 user nova-compute[73052]: iface.net_ifacename = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.ipaddress = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.prefix_len = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.hwaddress = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.transport_name = tcp
Aug 26 15:11:13 user nova-compute[73052]: iface.initiatorname = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.state = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.vlan_id = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.vlan_priority = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.vlan_state = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.iface_num = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.mtu = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.port = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.bootproto = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.subnet_mask = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.gateway = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.dhcp_alt_client_id = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.dhcp_dns = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.dhcp_learn_iqn = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.dhcp_vendor_id_state = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.dhcp_vendor_id = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.dhcp_slp_da = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.fragmentation = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.gratuitous_arp = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.incoming_forwarding = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.tos_state = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.tos = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.ttl = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.delayed_ack = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.tcp_nagle = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.tcp_wsf_state = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.tcp_wsf = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.tcp_timer_scale = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.tcp_timestamp = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.redirect = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.def_task_mgmt_timeout = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.header_digest = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.data_digest = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.immediate_data = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.initial_r2t = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.data_seq_inorder = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.data_pdu_inorder = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.erl = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.max_receive_data_len = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.first_burst_len = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.max_outstanding_r2t = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.max_burst_len = 0
Aug 26 15:11:13 user nova-compute[73052]: iface.chap_auth = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.bidi_chap = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.strict_login_compliance = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.discovery_auth = <empty>
Aug 26 15:11:13 user nova-compute[73052]: iface.discovery_logout = <empty>
Aug 26 15:11:13 user nova-compute[73052]: node.discovery_address = <empty>
Aug 26 15:11:13 user nova-compute[73052]: node.discovery_port = 0
Aug 26 15:11:13 user nova-compute[73052]: node.discovery_type = static
Aug 26 15:11:13 user nova-compute[73052]: node.session.initial_cmdsn = 0
Aug 26 15:11:13 user nova-compute[73052]: node.session.initial_login_retry_max = 8
Aug 26 15:11:13 user nova-compute[73052]: node.session.xmit_thread_priority = -20
Aug 26 15:11:13 user nova-compute[73052]: node.session.cmds_max = 128
Aug 26 15:11:13 user nova-compute[73052]: node.session.queue_depth = 32
Aug 26 15:11:13 user nova-compute[73052]: node.session.nr_sessions = 1
Aug 26 15:11:13 user nova-compute[73052]: node.session.auth.authmethod = CHAP
Aug 26 15:11:13 user nova-compute[73052]: node.session.auth.username = edaItkAT
Aug 26 15:11:13 user nova-compute[73052]: node.session.auth.password = ***
Aug 26 15:11:13 user nova-compute[73052]: node.session.auth.username_in = <empty>
Aug 26 15:11:13 user nova-compute[73052]: node.session.auth.password_in = <empty>
Aug 26 15:11:13 user nova-compute[73052]: node.session.auth.chap_algs = MD5
Aug 26 15:11:13 user nova-compute[73052]: node.session.timeo.replacement_timeout = 120
Aug 26 15:11:13 user nova-compute[73052]: node.session.err_timeo.abort_timeout = 15
Aug 26 15:11:13 user nova-compute[73052]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 15:11:13 user nova-compute[73052]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 15:11:13 user nova-compute[73052]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.FastAbort = Yes
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.InitialR2T = No
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.ImmediateData = Yes
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.MaxConnections = 1
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 15:11:13 user nova-compute[73052]: node.session.iscsi.ERL = 0
Aug 26 15:11:13 user nova-compute[73052]: node.session.scan = manual
Aug 26 15:11:13 user nova-compute[73052]: node.session.reopen_max = 0
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].address = 172.16.0.220
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].port = 3260
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].startup = manual
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].tcp.window_size = 524288
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].tcp.type_of_service = 0
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].timeo.logout_timeout = 15
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].timeo.login_timeout = 15
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].timeo.auth_timeout = 45
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].iscsi.DataDigest = None
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].iscsi.IFMarker = No
Aug 26 15:11:13 user nova-compute[73052]: node.conn[0].iscsi.OFMarker = No
Aug 26 15:11:13 user nova-compute[73052]: # END RECORD
Aug 26 15:11:13 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7598846-07d6-4e21-a64c-b8dec3bee6fa]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e51cf-294b-4de1-9678-9fb06b9e779d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edaItkAT {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edaItkAT" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec874e0-4e0d-460e-9b22-7cd9a89157de]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edaItkAT'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee38a33-86e5-4712-80f8-bec395926f8c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b461fc08-cfe3-4a40-8b3b-3a7cb31b0d1a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:13 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:13 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:13 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:13 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] HCTL ('33', '0', '0', 0) found on session 54 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[66deb6a9-8824-4d17-b3f7-1cf903b93b50]: (4, ('0 0 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Searching for a device in session 54 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edaItkAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] <== connect_volume: return (192ms) {'type': 'block', 'scsi_wwn': '23264303936363065', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264303936363065', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:13 user nova-compute[73052]: INFO nova.compute.manager [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Attaching volume 441b8a4b-91dc-45ad-b403-92d43f0d5db4 to /dev/vdb
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1856601229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1856601229',id=46,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-b5ksfpm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:09:46Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=f4d8a634-b9c6-471d-89df-fadec635aa07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "vif_mac": "fa:16:3e:1c:15:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "vif_mac": "fa:16:3e:1c:15:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:15:d2,bridge_name='br-int',has_traffic_filtering=True,id=caaa3974-b551-4bc1-8374-53623ff22df7,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa3974-b5') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'pci_devices' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.objects.base [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Object Instance<f4d8a634-b9c6-471d-89df-fadec635aa07> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:11:13 user nova-compute[73052]:   <uuid>f4d8a634-b9c6-471d-89df-fadec635aa07</uuid>
Aug 26 15:11:13 user nova-compute[73052]:   <name>instance-0000002e</name>
Aug 26 15:11:13 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:11:13 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:11:13 user nova-compute[73052]:   <metadata>
Aug 26 15:11:13 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:11:13 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:11:13 user nova-compute[73052]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1856601229</nova:name>
Aug 26 15:11:13 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:11:13</nova:creationTime>
Aug 26 15:11:13 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:11:13 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:11:13 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:11:13 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:11:13 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:11:13 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:11:13 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:11:13 user nova-compute[73052]:       <nova:owner>
Aug 26 15:11:13 user nova-compute[73052]:         <nova:user uuid="57f5f67238404fb9954260ad90a0a96d">tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member</nova:user>
Aug 26 15:11:13 user nova-compute[73052]:         <nova:project uuid="fe7051da8614456b9334b146fa3581fd">tempest-ServerBootFromVolumeStableRescueTest-505611186</nova:project>
Aug 26 15:11:13 user nova-compute[73052]:       </nova:owner>
Aug 26 15:11:13 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:11:13 user nova-compute[73052]:       <nova:ports>
Aug 26 15:11:13 user nova-compute[73052]:         <nova:port uuid="caaa3974-b551-4bc1-8374-53623ff22df7">
Aug 26 15:11:13 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 15:11:13 user nova-compute[73052]:         </nova:port>
Aug 26 15:11:13 user nova-compute[73052]:       </nova:ports>
Aug 26 15:11:13 user nova-compute[73052]:     </nova:instance>
Aug 26 15:11:13 user nova-compute[73052]:   </metadata>
Aug 26 15:11:13 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:11:13 user nova-compute[73052]:     <system>
Aug 26 15:11:13 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:11:13 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:11:13 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:11:13 user nova-compute[73052]:       <entry name="serial">f4d8a634-b9c6-471d-89df-fadec635aa07</entry>
Aug 26 15:11:13 user nova-compute[73052]:       <entry name="uuid">f4d8a634-b9c6-471d-89df-fadec635aa07</entry>
Aug 26 15:11:13 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:11:13 user nova-compute[73052]:     </system>
Aug 26 15:11:13 user nova-compute[73052]:   </sysinfo>
Aug 26 15:11:13 user nova-compute[73052]:   <os>
Aug 26 15:11:13 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:11:13 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:11:13 user nova-compute[73052]:   </os>
Aug 26 15:11:13 user nova-compute[73052]:   <features>
Aug 26 15:11:13 user nova-compute[73052]:     <acpi/>
Aug 26 15:11:13 user nova-compute[73052]:     <apic/>
Aug 26 15:11:13 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:11:13 user nova-compute[73052]:   </features>
Aug 26 15:11:13 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:11:13 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:11:13 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:11:13 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:11:13 user nova-compute[73052]:   </clock>
Aug 26 15:11:13 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:11:13 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:11:13 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:11:13 user nova-compute[73052]:   </cpu>
Aug 26 15:11:13 user nova-compute[73052]:   <devices>
Aug 26 15:11:13 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:11:13 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:11:13 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 15:11:13 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:11:13 user nova-compute[73052]:       <serial>97967ade-d979-49e1-9d55-e5775eee1250</serial>
Aug 26 15:11:13 user nova-compute[73052]:     </disk>
Aug 26 15:11:13 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:11:13 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:11:13 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue"/>
Aug 26 15:11:13 user nova-compute[73052]:       <target dev="vdb" bus="virtio"/>
Aug 26 15:11:13 user nova-compute[73052]:       <boot order="1"/>
Aug 26 15:11:13 user nova-compute[73052]:     </disk>
Aug 26 15:11:13 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:11:13 user nova-compute[73052]:       <mac address="fa:16:3e:1c:15:d2"/>
Aug 26 15:11:13 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:11:13 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:11:13 user nova-compute[73052]:       <target dev="tapcaaa3974-b5"/>
Aug 26 15:11:13 user nova-compute[73052]:     </interface>
Aug 26 15:11:13 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:11:13 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/console.log" append="off"/>
Aug 26 15:11:13 user nova-compute[73052]:     </serial>
Aug 26 15:11:13 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:11:13 user nova-compute[73052]:     <video>
Aug 26 15:11:13 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:11:13 user nova-compute[73052]:     </video>
Aug 26 15:11:13 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:11:13 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:11:13 user nova-compute[73052]:     </rng>
Aug 26 15:11:13 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:11:13 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:11:13 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:11:13 user nova-compute[73052]:     </memballoon>
Aug 26 15:11:13 user nova-compute[73052]:   </devices>
Aug 26 15:11:13 user nova-compute[73052]: </domain>
Aug 26 15:11:13 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.utils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance destroyed successfully.
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e06da-6205-4a64-b82b-5a8418545dca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fbf728-1472-4bc8-9dff-267f1a0eec01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f6ce04-75ff-4d74-851c-d38ad8c5e042]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a58ae-46cc-4171-830e-2728207f0fe6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] No VIF found with MAC fa:16:3e:1c:15:d2, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:11:13 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:11:13 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6a10da-303b-4787-801e-efa8261f3d61]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG os_brick.utils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:11:13 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Updating existing volume attachment record: 0dbd4e0a-1300-4cea-b455-62181a68e862 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:11:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-aff31368-e80b-486c-8c57-04bb907e5578 req-749e524a-d17b-491e-841d-e35fffac99d3 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:11:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-aff31368-e80b-486c-8c57-04bb907e5578 req-749e524a-d17b-491e-841d-e35fffac99d3 service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-aff31368-e80b-486c-8c57-04bb907e5578 req-749e524a-d17b-491e-841d-e35fffac99d3 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-aff31368-e80b-486c-8c57-04bb907e5578 req-749e524a-d17b-491e-841d-e35fffac99d3 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-aff31368-e80b-486c-8c57-04bb907e5578 req-749e524a-d17b-491e-841d-e35fffac99d3 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:11:15 user nova-compute[73052]: WARNING nova.compute.manager [req-aff31368-e80b-486c-8c57-04bb907e5578 req-749e524a-d17b-491e-841d-e35fffac99d3 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state active and task_state rescuing.
Aug 26 15:11:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:16 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:11:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:11:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:11:16 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-50c7e5b4-4fe7-4444-9692-ee851d612ac1 req-b5e92f4e-9a69-45c4-bdf8-a638369e1f8c service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-50c7e5b4-4fe7-4444-9692-ee851d612ac1 req-b5e92f4e-9a69-45c4-bdf8-a638369e1f8c service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-50c7e5b4-4fe7-4444-9692-ee851d612ac1 req-b5e92f4e-9a69-45c4-bdf8-a638369e1f8c service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-50c7e5b4-4fe7-4444-9692-ee851d612ac1 req-b5e92f4e-9a69-45c4-bdf8-a638369e1f8c service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-50c7e5b4-4fe7-4444-9692-ee851d612ac1 req-b5e92f4e-9a69-45c4-bdf8-a638369e1f8c service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:11:17 user nova-compute[73052]: WARNING nova.compute.manager [req-50c7e5b4-4fe7-4444-9692-ee851d612ac1 req-b5e92f4e-9a69-45c4-bdf8-a638369e1f8c service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state active and task_state rescuing.
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for f4d8a634-b9c6-471d-89df-fadec635aa07 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062677.3225179, f4d8a634-b9c6-471d-89df-fadec635aa07 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:11:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] VM Resumed (Lifecycle Event)
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7eb792a3-940a-4758-9f30-38c741b5db78 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Updating instance_info_cache with network_info: [{"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:11:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062677.32513, f4d8a634-b9c6-471d-89df-fadec635aa07 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:11:17 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] VM Started (Lifecycle Event)
Aug 26 15:11:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:11:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:19 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:23 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:24 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:11:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBUjfkzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:11:25 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:11:25 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:11:25 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51143d5-66bf-47f2-ada7-3a4c88576723]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:11:25 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f820f3b9-4ac6-4a49-8d20-a1ca48f1accf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4] added
Aug 26 15:11:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c0f0e1-be8f-49fc-89fe-77d0ceb0401e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[14051797-c2c5-4224-9ee3-b8a4af1d1668]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBUjfkzZ {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBUjfkzZ" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf01639-8aa9-45e9-8c6c-a1590a1bea3b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XBUjfkzZ'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a158434-428e-4f4c-b2ec-29f3c8412091]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[742670c8-f32d-41bb-8f7c-4d270cd683fd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:25 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:25 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a657bbaf-65cc-44b9-a903-82988acdbe10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4, portal: 172.16.0.220,3260]
Aug 26 15:11:25 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4, portal: 172.16.0.220,3260] successful.
Aug 26 15:11:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[707669df-43bd-4125-aaff-274e9beaadcb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5f8d06-e830-4239-a6bf-92c7eccf2e2e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:25 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:25 user nova-compute[73052]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)
Aug 26 15:11:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:25 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:25 user nova-compute[73052]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)
Aug 26 15:11:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[01814ba4-aa68-437e-acf9-22e6578164c9]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBUjfkzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:11:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26538616331376438', 'path': '/dev/sdc'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538616331376438', 'path': '/dev/sdc'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG nova.objects.instance [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:11:26 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:11:26 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 15:11:26 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:11:26 user nova-compute[73052]:   <serial>441b8a4b-91dc-45ad-b403-92d43f0d5db4</serial>
Aug 26 15:11:26 user nova-compute[73052]: </disk>
Aug 26 15:11:26 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:11:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:27 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:11:27 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8382MB free_disk=24.89110565185547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No VIF found with MAC fa:16:3e:62:e0:fe, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-52e1c26f-c111-430d-ad37-a969a4cea003 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.159s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance d3df938e-03c3-43ab-8dfd-73b056704ff4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f4d8a634-b9c6-471d-89df-fadec635aa07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:11:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:32 user nova-compute[73052]: INFO nova.compute.manager [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Attaching volume 4745633b-ab3e-4416-8924-379572d785c8 to /dev/vdc
Aug 26 15:11:32 user nova-compute[73052]: DEBUG os_brick.utils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a83555-5285-4ae3-bc9f-68869ec4f108]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee14ff3-46b2-4ded-854d-8c687a5f38fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa68cb3-2a5d-4695-a7e0-cef8ca3073f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fed167-fbdf-42fd-a52a-c2e910e09d0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:11:32 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:11:32 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[38484b0b-ee8d-4ad2-a203-b3e14f753002]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG os_brick.utils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:11:32 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Updating existing volume attachment record: 231bc1e5-5dde-41bc-9a1e-21523cff0ef6 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:11:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:38 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:11:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:11:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:11:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:11:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbkwgdSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:11:43 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:11:43 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:11:43 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[929dca18-416e-4d3e-b8f1-f56fbe5ecf19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:11:43 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc3adfd-f4ef-49a3-b7a0-11d631c821a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8] added
Aug 26 15:11:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[414eb69e-8819-4dea-8f2d-50773f12d0db]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[175ceb7a-3c2b-4346-a579-1a736789179d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbkwgdSn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbkwgdSn" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[39746ab6-c769-4e99-aed4-b1be68d8b248]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jbkwgdSn'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[998f5b47-cdfb-426a-8a75-0f9c9f963036]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[248ed19d-1b87-457d-b89b-36779460f314]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde3d690-cace-4c8e-bca1-57073c5f6ab8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8, portal: 172.16.0.220,3260]
Aug 26 15:11:43 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8, portal: 172.16.0.220,3260] successful.
Aug 26 15:11:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7540b826-90f6-46f5-a478-f2d0388f931c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9415b7c-66ce-4a9c-811c-a6837ac199a2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)
Aug 26 15:11:43 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[945dce61-ed22-4fe9-8d3c-8cbdf52dc176]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:43 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:11:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:11:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbkwgdSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:11:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:11:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23261616638623835', 'path': '/dev/sde'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:11:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261616638623835', 'path': '/dev/sde'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:11:44 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:11:44 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:11:44 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 15:11:44 user nova-compute[73052]:   <target dev="vdc" bus="virtio"/>
Aug 26 15:11:44 user nova-compute[73052]:   <serial>4745633b-ab3e-4416-8924-379572d785c8</serial>
Aug 26 15:11:44 user nova-compute[73052]: </disk>
Aug 26 15:11:44 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:11:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:11:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:11:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:11:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] No VIF found with MAC fa:16:3e:62:e0:fe, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:11:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c8ecb8a8-3ebf-4062-918c-7b857b0f0428 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.980s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:46 user nova-compute[73052]: INFO nova.compute.manager [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Detaching volume 441b8a4b-91dc-45ad-b403-92d43f0d5db4
Aug 26 15:11:46 user nova-compute[73052]: INFO nova.virt.block_device [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Attempting to driver detach volume 441b8a4b-91dc-45ad-b403-92d43f0d5db4 from mountpoint /dev/vdb
Aug 26 15:11:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Attempting to detach device vdb from instance d3df938e-03c3-43ab-8dfd-73b056704ff4 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:11:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:11:46 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:11:46 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 15:11:46 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:11:46 user nova-compute[73052]:   <serial>441b8a4b-91dc-45ad-b403-92d43f0d5db4</serial>
Aug 26 15:11:46 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:11:46 user nova-compute[73052]: </disk>
Aug 26 15:11:46 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:11:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully detached device vdb from instance d3df938e-03c3-43ab-8dfd-73b056704ff4 from the persistent domain config.
Aug 26 15:11:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3df938e-03c3-43ab-8dfd-73b056704ff4 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:11:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:11:46 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:11:46 user nova-compute[73052]:   <source dev="/dev/sdc"/>
Aug 26 15:11:46 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:11:46 user nova-compute[73052]:   <serial>441b8a4b-91dc-45ad-b403-92d43f0d5db4</serial>
Aug 26 15:11:46 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:11:46 user nova-compute[73052]: </disk>
Aug 26 15:11:46 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693062707.2272096, d3df938e-03c3-43ab-8dfd-73b056704ff4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:11:47 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully detached device vdb from instance d3df938e-03c3-43ab-8dfd-73b056704ff4 from the live domain config.
Aug 26 15:11:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBUjfkzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:11:47 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7814b2bc-843f-44d0-a8d7-9a17a5a5a2cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f8311d-07cc-489e-bd9a-30fe4f741973]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:47 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:47 user nova-compute[73052]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)
Aug 26 15:11:47 user nova-compute[73052]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)
Aug 26 15:11:47 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:47 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:47 user nova-compute[73052]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 (non-flash)
Aug 26 15:11:47 user nova-compute[73052]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)
Aug 26 15:11:47 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c518280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4'): ({'sdc'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Removing single pathed devices sdc {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f273c9-2819-4a45-9441-dbf5a7c5c660]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14114ef-ca9a-43d3-83b8-aba61f66e78b]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flushing IO for device /dev/sdc {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[478adf8e-78e8-4303-97d3-f27715e2e922]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac4d9a-de95-4d57-8b25-1f0ee6dc9790]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] SCSI volumes sdc have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d385c280-f7f2-4615-96b0-f86c6a565372]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cbd173-10f7-4852-ad43-7b524be779ea]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4, portal: 172.16.0.220,3260]
Aug 26 15:11:47 user nova-compute[73052]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4, portal: 172.16.0.220,3260] successful.
Aug 26 15:11:47 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8a4b-91dc-45ad-b403-92d43f0d5db4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ef2d3-8b82-418d-b91b-a4640f4b97f1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== disconnect_volume: return (281ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:11:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:48 user nova-compute[73052]: DEBUG nova.objects.instance [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eb267ee4-e300-4d7e-abc1-929a6081ec5d tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:49 user nova-compute[73052]: INFO nova.compute.manager [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Detaching volume 4745633b-ab3e-4416-8924-379572d785c8
Aug 26 15:11:49 user nova-compute[73052]: INFO nova.virt.block_device [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Attempting to driver detach volume 4745633b-ab3e-4416-8924-379572d785c8 from mountpoint /dev/vdc
Aug 26 15:11:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Attempting to detach device vdc from instance d3df938e-03c3-43ab-8dfd-73b056704ff4 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:11:49 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:11:49 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 15:11:49 user nova-compute[73052]:   <target dev="vdc" bus="virtio"/>
Aug 26 15:11:49 user nova-compute[73052]:   <serial>4745633b-ab3e-4416-8924-379572d785c8</serial>
Aug 26 15:11:49 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 15:11:49 user nova-compute[73052]: </disk>
Aug 26 15:11:49 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:11:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully detached device vdc from instance d3df938e-03c3-43ab-8dfd-73b056704ff4 from the persistent domain config.
Aug 26 15:11:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d3df938e-03c3-43ab-8dfd-73b056704ff4 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:11:49 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:11:49 user nova-compute[73052]:   <source dev="/dev/sde"/>
Aug 26 15:11:49 user nova-compute[73052]:   <target dev="vdc" bus="virtio"/>
Aug 26 15:11:49 user nova-compute[73052]:   <serial>4745633b-ab3e-4416-8924-379572d785c8</serial>
Aug 26 15:11:49 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 15:11:49 user nova-compute[73052]: </disk>
Aug 26 15:11:49 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693062709.8098598, d3df938e-03c3-43ab-8dfd-73b056704ff4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:11:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully detached device vdc from instance d3df938e-03c3-43ab-8dfd-73b056704ff4 from the live domain config.
Aug 26 15:11:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbkwgdSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:11:49 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b41ba-4922-4cac-8c40-0330be5212e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c846a3-27e8-4b2a-bdb6-bd8e48d10dde]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:49 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:49 user nova-compute[73052]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)
Aug 26 15:11:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:11:49 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:11:49 user nova-compute[73052]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 (non-flash)
Aug 26 15:11:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7f0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8'): ({'sde'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Removing single pathed devices sde {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc06694-cd2c-4c93-a331-19e49e4c9ff2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abeb843-41e9-4465-bed5-be8b9ca9a2e1]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Flushing IO for device /dev/sde {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[005257a1-492b-4dd0-acd8-21b6c3fcd449]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[376b3406-5a97-4b42-935d-d2830c389b69]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] SCSI volumes sde have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:11:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40c4aab-ead9-4620-9b0b-d4284993eb27]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[94417998-ca90-447d-bd97-c397d3dfb552]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8, portal: 172.16.0.220,3260]
Aug 26 15:11:50 user nova-compute[73052]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8, portal: 172.16.0.220,3260] successful.
Aug 26 15:11:50 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4745633b-ab3e-4416-8924-379572d785c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84d79b0-dacb-4a33-be96-4c5235aa8a8e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] <== disconnect_volume: return (286ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'flavor' on Instance uuid d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7cca9712-91fc-4dc7-b55f-1788a203cf0f tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:51 user nova-compute[73052]: INFO nova.compute.manager [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Terminating instance
Aug 26 15:11:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-56deb714-9b4b-416b-a9a2-69f939bc4433 req-2b660d4f-759d-4c94-893f-027ac740d221 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received event network-vif-unplugged-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-56deb714-9b4b-416b-a9a2-69f939bc4433 req-2b660d4f-759d-4c94-893f-027ac740d221 service nova] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-56deb714-9b4b-416b-a9a2-69f939bc4433 req-2b660d4f-759d-4c94-893f-027ac740d221 service nova] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-56deb714-9b4b-416b-a9a2-69f939bc4433 req-2b660d4f-759d-4c94-893f-027ac740d221 service nova] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-56deb714-9b4b-416b-a9a2-69f939bc4433 req-2b660d4f-759d-4c94-893f-027ac740d221 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] No waiting events found dispatching network-vif-unplugged-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-56deb714-9b4b-416b-a9a2-69f939bc4433 req-2b660d4f-759d-4c94-893f-027ac740d221 service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received event network-vif-unplugged-22d636cd-96ba-46d8-b68a-8025430c4f20 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Instance destroyed successfully.
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lazy-loading 'resources' on Instance uuid d3df938e-03c3-43ab-8dfd-73b056704ff4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2088320085',display_name='tempest-AttachVolumeTestJSON-server-2088320085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2088320085',id=45,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO1xjK629PmoUlnNqrYjnD8+L0gN5d6s/z+HLuMuAiK++5ueCpFfgBFnr1SfXoGCAJVylxOpUivB53HgfIBHGdF8+wO/T5IwER1xMeeHZGoiE2uWsjo3xy8ZjM5mhDwHg==',key_name='tempest-keypair-1025338331',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f05c842807aa4763b4e319c8098ba064',ramdisk_id='',reservation_id='r-z00tba40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-68461294',owner_user_name='tempest-AttachVolumeTestJSON-68461294-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8677e9414700404ea8a9cf07cae299b2',uuid=d3df938e-03c3-43ab-8dfd-73b056704ff4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converting VIF {"id": "22d636cd-96ba-46d8-b68a-8025430c4f20", "address": "fa:16:3e:62:e0:fe", "network": {"id": "c50c71a9-4ad1-455e-8d7d-ccebf2974c6b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1079387550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05c842807aa4763b4e319c8098ba064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d636cd-96", "ovs_interfaceid": "22d636cd-96ba-46d8-b68a-8025430c4f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=22d636cd-96ba-46d8-b68a-8025430c4f20,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d636cd-96') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG os_vif [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=22d636cd-96ba-46d8-b68a-8025430c4f20,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d636cd-96') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22d636cd-96, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:11:52 user nova-compute[73052]: INFO os_vif [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e0:fe,bridge_name='br-int',has_traffic_filtering=True,id=22d636cd-96ba-46d8-b68a-8025430c4f20,network=Network(c50c71a9-4ad1-455e-8d7d-ccebf2974c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d636cd-96')
Aug 26 15:11:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Deleting instance files /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4_del
Aug 26 15:11:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Deletion of /opt/stack/data/nova/instances/d3df938e-03c3-43ab-8dfd-73b056704ff4_del complete
Aug 26 15:11:52 user nova-compute[73052]: INFO nova.compute.manager [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 15:11:52 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:11:52 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:11:53 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:11:53 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Took 0.97 seconds to deallocate network for instance.
Aug 26 15:11:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-4e99ce27-e9fa-4f8c-9bf7-7e9aba50c9f5 req-b5cfa5de-19e0-4ebe-afa1-dca40e6b48fa service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received event network-vif-deleted-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:11:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:53 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:11:53 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:11:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:54 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Deleted allocations for instance d3df938e-03c3-43ab-8dfd-73b056704ff4
Aug 26 15:11:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-40ba2633-78a6-47ac-a476-620078688e29 tempest-AttachVolumeTestJSON-68461294 tempest-AttachVolumeTestJSON-68461294-project-member] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-5c0bf1ef-463c-49dd-a6ef-852b79395b3b req-929fd71b-18d5-424e-b6cb-31e9072a1a4f service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received event network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:11:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5c0bf1ef-463c-49dd-a6ef-852b79395b3b req-929fd71b-18d5-424e-b6cb-31e9072a1a4f service nova] Acquiring lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:11:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5c0bf1ef-463c-49dd-a6ef-852b79395b3b req-929fd71b-18d5-424e-b6cb-31e9072a1a4f service nova] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:11:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5c0bf1ef-463c-49dd-a6ef-852b79395b3b req-929fd71b-18d5-424e-b6cb-31e9072a1a4f service nova] Lock "d3df938e-03c3-43ab-8dfd-73b056704ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:11:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-5c0bf1ef-463c-49dd-a6ef-852b79395b3b req-929fd71b-18d5-424e-b6cb-31e9072a1a4f service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] No waiting events found dispatching network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:11:54 user nova-compute[73052]: WARNING nova.compute.manager [req-5c0bf1ef-463c-49dd-a6ef-852b79395b3b req-929fd71b-18d5-424e-b6cb-31e9072a1a4f service nova] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Received unexpected event network-vif-plugged-22d636cd-96ba-46d8-b68a-8025430c4f20 for instance with vm_state deleted and task_state None.
Aug 26 15:11:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:11:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:07 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062712.6715539, d3df938e-03c3-43ab-8dfd-73b056704ff4 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:12:07 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] VM Stopped (Lifecycle Event)
Aug 26 15:12:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-00838b60-6535-4331-b207-e01ac7f79abb None None] [instance: d3df938e-03c3-43ab-8dfd-73b056704ff4] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:12:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:12:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:12:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:12:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:12:17 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 35013e14-c22c-439a-923f-61b1b98ce6b8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:12:18 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:12:18 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:12:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:12:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:12:19 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:23 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:25 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:12:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:12:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:12:25 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:12:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:12:26 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:12:27 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:12:27 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8594MB free_disk=24.908401489257812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f4d8a634-b9c6-471d-89df-fadec635aa07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:12:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:12:28 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:12:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:12:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:12:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:12:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:12:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:12:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:12:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:12:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:12:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:13:00 user nova-compute[73052]: INFO nova.compute.manager [None req-3257a881-68c4-4dd1-9e28-6eb25896fd29 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Unrescuing
Aug 26 15:13:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3257a881-68c4-4dd1-9e28-6eb25896fd29 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:13:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3257a881-68c4-4dd1-9e28-6eb25896fd29 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquired lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:13:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3257a881-68c4-4dd1-9e28-6eb25896fd29 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:13:00 user nova-compute[73052]: DEBUG nova.network.neutron [None req-3257a881-68c4-4dd1-9e28-6eb25896fd29 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Updating instance_info_cache with network_info: [{"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:13:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3257a881-68c4-4dd1-9e28-6eb25896fd29 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Releasing lock "refresh_cache-f4d8a634-b9c6-471d-89df-fadec635aa07" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:13:00 user nova-compute[73052]: DEBUG nova.objects.instance [None req-3257a881-68c4-4dd1-9e28-6eb25896fd29 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'flavor' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:13:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-e39f3c18-1b95-4c35-ba76-9ab9c8d228aa req-625ebcd9-bd3d-4a78-9914-3fb7ada61c74 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:13:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e39f3c18-1b95-4c35-ba76-9ab9c8d228aa req-625ebcd9-bd3d-4a78-9914-3fb7ada61c74 service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e39f3c18-1b95-4c35-ba76-9ab9c8d228aa req-625ebcd9-bd3d-4a78-9914-3fb7ada61c74 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e39f3c18-1b95-4c35-ba76-9ab9c8d228aa req-625ebcd9-bd3d-4a78-9914-3fb7ada61c74 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:01 user nova-compute[73052]: DEBUG nova.compute.manager [req-e39f3c18-1b95-4c35-ba76-9ab9c8d228aa req-625ebcd9-bd3d-4a78-9914-3fb7ada61c74 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:13:01 user nova-compute[73052]: WARNING nova.compute.manager [req-e39f3c18-1b95-4c35-ba76-9ab9c8d228aa req-625ebcd9-bd3d-4a78-9914-3fb7ada61c74 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 15:13:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:01 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance destroyed successfully.
Aug 26 15:13:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-54db12f7-810f-47d5-9912-7a841b339c6e req-57f7d56e-e8f2-4cbc-a1ec-5781465c4f7a service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-54db12f7-810f-47d5-9912-7a841b339c6e req-57f7d56e-e8f2-4cbc-a1ec-5781465c4f7a service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-54db12f7-810f-47d5-9912-7a841b339c6e req-57f7d56e-e8f2-4cbc-a1ec-5781465c4f7a service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-54db12f7-810f-47d5-9912-7a841b339c6e req-57f7d56e-e8f2-4cbc-a1ec-5781465c4f7a service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG nova.compute.manager [req-54db12f7-810f-47d5-9912-7a841b339c6e req-57f7d56e-e8f2-4cbc-a1ec-5781465c4f7a service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:13:03 user nova-compute[73052]: WARNING nova.compute.manager [req-54db12f7-810f-47d5-9912-7a841b339c6e req-57f7d56e-e8f2-4cbc-a1ec-5781465c4f7a service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 15:13:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:13:05 user nova-compute[73052]: WARNING nova.compute.manager [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:13:05 user nova-compute[73052]: WARNING nova.compute.manager [req-83174a16-ee3d-4551-a7c7-ff8e8efd9d0b req-236e90d0-decc-4a5a-8c39-f857a7e8036e service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Removed pending event for f4d8a634-b9c6-471d-89df-fadec635aa07 due to event {{(pid=73052) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062785.5056415, f4d8a634-b9c6-471d-89df-fadec635aa07 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:13:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] VM Resumed (Lifecycle Event)
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3257a881-68c4-4dd1-9e28-6eb25896fd29 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:13:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062785.506725, f4d8a634-b9c6-471d-89df-fadec635aa07 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:13:05 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] VM Started (Lifecycle Event)
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:13:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:13:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:13:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:13:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:13:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:18 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:13:19 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:13:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:13:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:13:19 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:13:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating instance_info_cache with network_info: [{"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:13:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-8089746e-24d8-4792-a97b-62193a2ad808" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:13:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:13:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:13:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:27 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:13:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:13:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=24.907123565673828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f4d8a634-b9c6-471d-89df-fadec635aa07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:13:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:13:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:13:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:13:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:13:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:13:48 user nova-compute[73052]: INFO nova.compute.claims [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Claim successful on node user
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:13:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.policy [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '668bd35e13084c369f4c9506b79e895f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0a5844be74c6db82f84ffba67cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:13:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Creating image(s)
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "/opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "/opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "/opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk 1073741824" returned: 0 in 0.053s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Successfully created port: 5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Cannot resize image /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Ensure instance console log exists: /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Successfully updated port: 5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "refresh_cache-432cebf0-e35d-44fe-9224-ac7794472c5e" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquired lock "refresh_cache-432cebf0-e35d-44fe-9224-ac7794472c5e" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-e42c4775-2531-43cb-8fc4-cf12492a985c req-6bd2b798-3529-49d6-bcc0-50b5cad9ef4b service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-changed-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.compute.manager [req-e42c4775-2531-43cb-8fc4-cf12492a985c req-6bd2b798-3529-49d6-bcc0-50b5cad9ef4b service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Refreshing instance network info cache due to event network-changed-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e42c4775-2531-43cb-8fc4-cf12492a985c req-6bd2b798-3529-49d6-bcc0-50b5cad9ef4b service nova] Acquiring lock "refresh_cache-432cebf0-e35d-44fe-9224-ac7794472c5e" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Updating instance_info_cache with network_info: [{"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Releasing lock "refresh_cache-432cebf0-e35d-44fe-9224-ac7794472c5e" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Instance network_info: |[{"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e42c4775-2531-43cb-8fc4-cf12492a985c req-6bd2b798-3529-49d6-bcc0-50b5cad9ef4b service nova] Acquired lock "refresh_cache-432cebf0-e35d-44fe-9224-ac7794472c5e" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.neutron [req-e42c4775-2531-43cb-8fc4-cf12492a985c req-6bd2b798-3529-49d6-bcc0-50b5cad9ef4b service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Refreshing network info cache for port 5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Start _get_guest_xml network_info=[{"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:13:50 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:13:50 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-49857269',display_name='tempest-VolumesNegativeTest-instance-49857269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-49857269',id=47,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5f0a5844be74c6db82f84ffba67cd01',ramdisk_id='',reservation_id='r-7zbixoh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-822202326',owner_user_name='tempest-VolumesNegativeTest-822202326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:13:49Z,user_data=None,user_id='668bd35e13084c369f4c9506b79e895f',uuid=432cebf0-e35d-44fe-9224-ac7794472c5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Converting VIF {"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d4:77,bridge_name='br-int',has_traffic_filtering=True,id=5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c,network=Network(365bd1e8-4c48-409c-a7af-211adccc8f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d07aeda-3b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lazy-loading 'pci_devices' on Instance uuid 432cebf0-e35d-44fe-9224-ac7794472c5e {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:13:50 user nova-compute[73052]:   <uuid>432cebf0-e35d-44fe-9224-ac7794472c5e</uuid>
Aug 26 15:13:50 user nova-compute[73052]:   <name>instance-0000002f</name>
Aug 26 15:13:50 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:13:50 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:13:50 user nova-compute[73052]:   <metadata>
Aug 26 15:13:50 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:13:50 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:13:50 user nova-compute[73052]:       <nova:name>tempest-VolumesNegativeTest-instance-49857269</nova:name>
Aug 26 15:13:50 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:13:50</nova:creationTime>
Aug 26 15:13:50 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:13:50 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:13:50 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:13:50 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:13:50 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:13:50 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:13:50 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:13:50 user nova-compute[73052]:       <nova:owner>
Aug 26 15:13:50 user nova-compute[73052]:         <nova:user uuid="668bd35e13084c369f4c9506b79e895f">tempest-VolumesNegativeTest-822202326-project-member</nova:user>
Aug 26 15:13:50 user nova-compute[73052]:         <nova:project uuid="d5f0a5844be74c6db82f84ffba67cd01">tempest-VolumesNegativeTest-822202326</nova:project>
Aug 26 15:13:50 user nova-compute[73052]:       </nova:owner>
Aug 26 15:13:50 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:13:50 user nova-compute[73052]:       <nova:ports>
Aug 26 15:13:50 user nova-compute[73052]:         <nova:port uuid="5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c">
Aug 26 15:13:50 user nova-compute[73052]:           <nova:ip type="fixed" address="192.168.233.192" ipVersion="4"/>
Aug 26 15:13:50 user nova-compute[73052]:         </nova:port>
Aug 26 15:13:50 user nova-compute[73052]:       </nova:ports>
Aug 26 15:13:50 user nova-compute[73052]:     </nova:instance>
Aug 26 15:13:50 user nova-compute[73052]:   </metadata>
Aug 26 15:13:50 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:13:50 user nova-compute[73052]:     <system>
Aug 26 15:13:50 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:13:50 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:13:50 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:13:50 user nova-compute[73052]:       <entry name="serial">432cebf0-e35d-44fe-9224-ac7794472c5e</entry>
Aug 26 15:13:50 user nova-compute[73052]:       <entry name="uuid">432cebf0-e35d-44fe-9224-ac7794472c5e</entry>
Aug 26 15:13:50 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:13:50 user nova-compute[73052]:     </system>
Aug 26 15:13:50 user nova-compute[73052]:   </sysinfo>
Aug 26 15:13:50 user nova-compute[73052]:   <os>
Aug 26 15:13:50 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:13:50 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:13:50 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:13:50 user nova-compute[73052]:   </os>
Aug 26 15:13:50 user nova-compute[73052]:   <features>
Aug 26 15:13:50 user nova-compute[73052]:     <acpi/>
Aug 26 15:13:50 user nova-compute[73052]:     <apic/>
Aug 26 15:13:50 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:13:50 user nova-compute[73052]:   </features>
Aug 26 15:13:50 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:13:50 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:13:50 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:13:50 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:13:50 user nova-compute[73052]:   </clock>
Aug 26 15:13:50 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:13:50 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:13:50 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:13:50 user nova-compute[73052]:   </cpu>
Aug 26 15:13:50 user nova-compute[73052]:   <devices>
Aug 26 15:13:50 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:13:50 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:13:50 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk"/>
Aug 26 15:13:50 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:13:50 user nova-compute[73052]:     </disk>
Aug 26 15:13:50 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:13:50 user nova-compute[73052]:       <mac address="fa:16:3e:37:d4:77"/>
Aug 26 15:13:50 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:13:50 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:13:50 user nova-compute[73052]:       <target dev="tap5d07aeda-3b"/>
Aug 26 15:13:50 user nova-compute[73052]:     </interface>
Aug 26 15:13:50 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:13:50 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/console.log" append="off"/>
Aug 26 15:13:50 user nova-compute[73052]:     </serial>
Aug 26 15:13:50 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:13:50 user nova-compute[73052]:     <video>
Aug 26 15:13:50 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:13:50 user nova-compute[73052]:     </video>
Aug 26 15:13:50 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:13:50 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:13:50 user nova-compute[73052]:     </rng>
Aug 26 15:13:50 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:13:50 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:13:50 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:13:50 user nova-compute[73052]:     </memballoon>
Aug 26 15:13:50 user nova-compute[73052]:   </devices>
Aug 26 15:13:50 user nova-compute[73052]: </domain>
Aug 26 15:13:50 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-49857269',display_name='tempest-VolumesNegativeTest-instance-49857269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-49857269',id=47,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5f0a5844be74c6db82f84ffba67cd01',ramdisk_id='',reservation_id='r-7zbixoh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-822202326',owner_user_name='tempest-VolumesNegativeTest-822202326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:13:49Z,user_data=None,user_id='668bd35e13084c369f4c9506b79e895f',uuid=432cebf0-e35d-44fe-9224-ac7794472c5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Converting VIF {"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d4:77,bridge_name='br-int',has_traffic_filtering=True,id=5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c,network=Network(365bd1e8-4c48-409c-a7af-211adccc8f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d07aeda-3b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG os_vif [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d4:77,bridge_name='br-int',has_traffic_filtering=True,id=5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c,network=Network(365bd1e8-4c48-409c-a7af-211adccc8f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d07aeda-3b') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d07aeda-3b, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d07aeda-3b, col_values=(('external_ids', {'iface-id': '5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:d4:77', 'vm-uuid': '432cebf0-e35d-44fe-9224-ac7794472c5e'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:50 user nova-compute[73052]: INFO os_vif [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d4:77,bridge_name='br-int',has_traffic_filtering=True,id=5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c,network=Network(365bd1e8-4c48-409c-a7af-211adccc8f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d07aeda-3b')
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:13:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] No VIF found with MAC fa:16:3e:37:d4:77, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:13:51 user nova-compute[73052]: DEBUG nova.network.neutron [req-e42c4775-2531-43cb-8fc4-cf12492a985c req-6bd2b798-3529-49d6-bcc0-50b5cad9ef4b service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Updated VIF entry in instance network info cache for port 5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:13:51 user nova-compute[73052]: DEBUG nova.network.neutron [req-e42c4775-2531-43cb-8fc4-cf12492a985c req-6bd2b798-3529-49d6-bcc0-50b5cad9ef4b service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Updating instance_info_cache with network_info: [{"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:13:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e42c4775-2531-43cb-8fc4-cf12492a985c req-6bd2b798-3529-49d6-bcc0-50b5cad9ef4b service nova] Releasing lock "refresh_cache-432cebf0-e35d-44fe-9224-ac7794472c5e" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-b8ad1aed-9101-4eba-9e90-25d727b8d951 req-5a2843cb-ffae-4522-a470-4ecdd7701ac9 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8ad1aed-9101-4eba-9e90-25d727b8d951 req-5a2843cb-ffae-4522-a470-4ecdd7701ac9 service nova] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8ad1aed-9101-4eba-9e90-25d727b8d951 req-5a2843cb-ffae-4522-a470-4ecdd7701ac9 service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b8ad1aed-9101-4eba-9e90-25d727b8d951 req-5a2843cb-ffae-4522-a470-4ecdd7701ac9 service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-b8ad1aed-9101-4eba-9e90-25d727b8d951 req-5a2843cb-ffae-4522-a470-4ecdd7701ac9 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] No waiting events found dispatching network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:13:52 user nova-compute[73052]: WARNING nova.compute.manager [req-b8ad1aed-9101-4eba-9e90-25d727b8d951 req-5a2843cb-ffae-4522-a470-4ecdd7701ac9 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received unexpected event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c for instance with vm_state building and task_state spawning.
Aug 26 15:13:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062834.268608, 432cebf0-e35d-44fe-9224-ac7794472c5e => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:13:54 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] VM Resumed (Lifecycle Event)
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:13:54 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Instance spawned successfully.
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:13:54 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693062834.2726374, 432cebf0-e35d-44fe-9224-ac7794472c5e => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:13:54 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] VM Started (Lifecycle Event)
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:13:54 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:13:54 user nova-compute[73052]: INFO nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:13:54 user nova-compute[73052]: INFO nova.compute.manager [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Took 6.03 seconds to build instance.
Aug 26 15:13:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c911a16-3c6d-4cb3-8a70-43caf814d0ea tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.121s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-77362b64-f81e-401a-b018-7311a48761ea req-7f29c0bd-6995-450c-bfc6-a64458135759 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-77362b64-f81e-401a-b018-7311a48761ea req-7f29c0bd-6995-450c-bfc6-a64458135759 service nova] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-77362b64-f81e-401a-b018-7311a48761ea req-7f29c0bd-6995-450c-bfc6-a64458135759 service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-77362b64-f81e-401a-b018-7311a48761ea req-7f29c0bd-6995-450c-bfc6-a64458135759 service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:13:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-77362b64-f81e-401a-b018-7311a48761ea req-7f29c0bd-6995-450c-bfc6-a64458135759 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] No waiting events found dispatching network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:13:54 user nova-compute[73052]: WARNING nova.compute.manager [req-77362b64-f81e-401a-b018-7311a48761ea req-7f29c0bd-6995-450c-bfc6-a64458135759 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received unexpected event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c for instance with vm_state active and task_state None.
Aug 26 15:13:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:13:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:14:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:14:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:14:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:14:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:14:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:14:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:14:21 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:14:21 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:14:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Updating instance_info_cache with network_info: [{"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:14:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-dd55bbdc-8b92-462e-b8ee-b391314ac20c" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:14:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:14:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:14:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:25 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:14:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:14:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:14:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:14:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:31 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:14:31 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=24.877071380615234GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance f4d8a634-b9c6-471d-89df-fadec635aa07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 432cebf0-e35d-44fe-9224-ac7794472c5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:14:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:14:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:14:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:14:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:14:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:14:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:14:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:14:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:14:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:14:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:14:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:14:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:14:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:14:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:14:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:14:51 user nova-compute[73052]: INFO nova.compute.manager [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Terminating instance
Aug 26 15:14:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-3fc49d9e-f45c-48fb-8d8f-9030389f5e7c req-1fd12a47-40df-484c-80c9-321c5b945885 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3fc49d9e-f45c-48fb-8d8f-9030389f5e7c req-1fd12a47-40df-484c-80c9-321c5b945885 service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3fc49d9e-f45c-48fb-8d8f-9030389f5e7c req-1fd12a47-40df-484c-80c9-321c5b945885 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-3fc49d9e-f45c-48fb-8d8f-9030389f5e7c req-1fd12a47-40df-484c-80c9-321c5b945885 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-3fc49d9e-f45c-48fb-8d8f-9030389f5e7c req-1fd12a47-40df-484c-80c9-321c5b945885 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG nova.compute.manager [req-3fc49d9e-f45c-48fb-8d8f-9030389f5e7c req-1fd12a47-40df-484c-80c9-321c5b945885 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-unplugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Instance destroyed successfully.
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'resources' on Instance uuid f4d8a634-b9c6-471d-89df-fadec635aa07 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1856601229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1856601229',id=46,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:11:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-b5ksfpm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:13:06Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=f4d8a634-b9c6-471d-89df-fadec635aa07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "caaa3974-b551-4bc1-8374-53623ff22df7", "address": "fa:16:3e:1c:15:d2", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa3974-b5", "ovs_interfaceid": "caaa3974-b551-4bc1-8374-53623ff22df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:15:d2,bridge_name='br-int',has_traffic_filtering=True,id=caaa3974-b551-4bc1-8374-53623ff22df7,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa3974-b5') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_vif [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:15:d2,bridge_name='br-int',has_traffic_filtering=True,id=caaa3974-b551-4bc1-8374-53623ff22df7,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa3974-b5') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcaaa3974-b5, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:14:52 user nova-compute[73052]: INFO os_vif [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:15:d2,bridge_name='br-int',has_traffic_filtering=True,id=caaa3974-b551-4bc1-8374-53623ff22df7,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa3974-b5')
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edaItkAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:14:52 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e091c579-89b9-4b7e-93ed-d13ac57044e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fca2219-bf7b-430f-aef6-4bf983176024]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:14:52 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:14:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:14:52 user nova-compute[73052]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 (non-flash)
Aug 26 15:14:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7217e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d74e48-d23b-4ad2-af82-44fc93f80e41]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c57b90-0524-4bd7-bad3-61dda73affc1]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d2663-92c9-40c8-9239-40641ebdc4dc]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a9cee-54e5-48f2-8871-1639fdbcef89]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ef9327c5', '/dev/disk/by-id/scsi-1SCST_BIOef9327c5-2d09660e7ca8fbf2', '/dev/disk/by-id/scsi-23264303936363065') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[50647df4-eaa0-468c-8621-ea36a156d0f2]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cf4d97-89e2-4fe3-b39a-2f58851416d6]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[76783aaf-bc7c-4331-b69b-c3d1eb3251cc]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250, portal: 172.16.0.220,3260]
Aug 26 15:14:52 user nova-compute[73052]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250, portal: 172.16.0.220,3260] successful.
Aug 26 15:14:52 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97967ade-d979-49e1-9d55-e5775eee1250 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58f912d-dbad-4411-8f2b-8d982f44b1f1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] <== disconnect_volume: return (282ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:14:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Deleting instance files /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07_del
Aug 26 15:14:52 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Deletion of /opt/stack/data/nova/instances/f4d8a634-b9c6-471d-89df-fadec635aa07_del complete
Aug 26 15:14:52 user nova-compute[73052]: INFO nova.compute.manager [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 15:14:52 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:14:52 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:14:52 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Took 0.54 seconds to deallocate network for instance.
Aug 26 15:14:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-33998981-85d1-421f-a0ad-e22081c345db req-5838e852-07f2-4926-9352-60da80cdec39 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:14:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-33998981-85d1-421f-a0ad-e22081c345db req-5838e852-07f2-4926-9352-60da80cdec39 service nova] Acquiring lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:14:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-33998981-85d1-421f-a0ad-e22081c345db req-5838e852-07f2-4926-9352-60da80cdec39 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:14:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-33998981-85d1-421f-a0ad-e22081c345db req-5838e852-07f2-4926-9352-60da80cdec39 service nova] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:14:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-33998981-85d1-421f-a0ad-e22081c345db req-5838e852-07f2-4926-9352-60da80cdec39 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] No waiting events found dispatching network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:14:53 user nova-compute[73052]: WARNING nova.compute.manager [req-33998981-85d1-421f-a0ad-e22081c345db req-5838e852-07f2-4926-9352-60da80cdec39 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received unexpected event network-vif-plugged-caaa3974-b551-4bc1-8374-53623ff22df7 for instance with vm_state active and task_state deleting.
Aug 26 15:14:53 user nova-compute[73052]: DEBUG nova.compute.manager [req-33998981-85d1-421f-a0ad-e22081c345db req-5838e852-07f2-4926-9352-60da80cdec39 service nova] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Received event network-vif-deleted-caaa3974-b551-4bc1-8374-53623ff22df7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:14:53 user nova-compute[73052]: INFO nova.compute.manager [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Took 0.76 seconds to detach 1 volumes for instance.
Aug 26 15:14:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:14:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:14:53 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:14:53 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:14:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:14:54 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Deleted allocations for instance f4d8a634-b9c6-471d-89df-fadec635aa07
Aug 26 15:14:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b2367d42-2e1f-4503-9ece-085972e56541 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "f4d8a634-b9c6-471d-89df-fadec635aa07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.835s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:14:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:07 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062892.0552897, f4d8a634-b9c6-471d-89df-fadec635aa07 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:15:07 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] VM Stopped (Lifecycle Event)
Aug 26 15:15:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0a23d0de-d0e4-438f-9009-bd50fe661c15 None None] [instance: f4d8a634-b9c6-471d-89df-fadec635aa07] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:15:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:15:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:19 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:15:19 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:15:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:15:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:15:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:23 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:23 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:15:28 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:15:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:15:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:15:31 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:15:31 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8624MB free_disk=24.876174926757812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance dd55bbdc-8b92-462e-b8ee-b391314ac20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 432cebf0-e35d-44fe-9224-ac7794472c5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:15:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:15:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:38 user nova-compute[73052]: INFO nova.compute.manager [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Terminating instance
Aug 26 15:15:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-517e6996-0847-42df-bee0-ec307fb76cff req-f5594088-5fdd-49be-ac48-8f792543d856 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-unplugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-517e6996-0847-42df-bee0-ec307fb76cff req-f5594088-5fdd-49be-ac48-8f792543d856 service nova] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-517e6996-0847-42df-bee0-ec307fb76cff req-f5594088-5fdd-49be-ac48-8f792543d856 service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-517e6996-0847-42df-bee0-ec307fb76cff req-f5594088-5fdd-49be-ac48-8f792543d856 service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-517e6996-0847-42df-bee0-ec307fb76cff req-f5594088-5fdd-49be-ac48-8f792543d856 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] No waiting events found dispatching network-vif-unplugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:15:38 user nova-compute[73052]: DEBUG nova.compute.manager [req-517e6996-0847-42df-bee0-ec307fb76cff req-f5594088-5fdd-49be-ac48-8f792543d856 service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-unplugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Instance destroyed successfully.
Aug 26 15:15:39 user nova-compute[73052]: DEBUG nova.objects.instance [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lazy-loading 'resources' on Instance uuid 432cebf0-e35d-44fe-9224-ac7794472c5e {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-49857269',display_name='tempest-VolumesNegativeTest-instance-49857269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-49857269',id=47,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5f0a5844be74c6db82f84ffba67cd01',ramdisk_id='',reservation_id='r-7zbixoh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-822202326',owner_user_name='tempest-VolumesNegativeTest-822202326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:13:54Z,user_data=None,user_id='668bd35e13084c369f4c9506b79e895f',uuid=432cebf0-e35d-44fe-9224-ac7794472c5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Converting VIF {"id": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "address": "fa:16:3e:37:d4:77", "network": {"id": "365bd1e8-4c48-409c-a7af-211adccc8f90", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e028da825034e66a38c96828c9fe4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d07aeda-3b", "ovs_interfaceid": "5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d4:77,bridge_name='br-int',has_traffic_filtering=True,id=5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c,network=Network(365bd1e8-4c48-409c-a7af-211adccc8f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d07aeda-3b') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG os_vif [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d4:77,bridge_name='br-int',has_traffic_filtering=True,id=5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c,network=Network(365bd1e8-4c48-409c-a7af-211adccc8f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d07aeda-3b') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d07aeda-3b, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:15:39 user nova-compute[73052]: INFO os_vif [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d4:77,bridge_name='br-int',has_traffic_filtering=True,id=5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c,network=Network(365bd1e8-4c48-409c-a7af-211adccc8f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d07aeda-3b')
Aug 26 15:15:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Deleting instance files /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e_del
Aug 26 15:15:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Deletion of /opt/stack/data/nova/instances/432cebf0-e35d-44fe-9224-ac7794472c5e_del complete
Aug 26 15:15:39 user nova-compute[73052]: INFO nova.compute.manager [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 15:15:39 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:15:40 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Took 1.12 seconds to deallocate network for instance.
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] No waiting events found dispatching network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:15:40 user nova-compute[73052]: WARNING nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received unexpected event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c for instance with vm_state deleted and task_state None.
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] No waiting events found dispatching network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:15:40 user nova-compute[73052]: WARNING nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received unexpected event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c for instance with vm_state deleted and task_state None.
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] No waiting events found dispatching network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:15:40 user nova-compute[73052]: WARNING nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received unexpected event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c for instance with vm_state deleted and task_state None.
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-unplugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] No waiting events found dispatching network-vif-unplugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:15:40 user nova-compute[73052]: WARNING nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received unexpected event network-vif-unplugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c for instance with vm_state deleted and task_state None.
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Acquiring lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] No waiting events found dispatching network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:15:40 user nova-compute[73052]: WARNING nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received unexpected event network-vif-plugged-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c for instance with vm_state deleted and task_state None.
Aug 26 15:15:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-47e29161-a2b6-40cf-b536-bec28cd5dcb3 req-61bf6289-a505-41ea-ab8c-6e48ba2c7cbc service nova] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Received event network-vif-deleted-5d07aeda-3b04-4ea0-8bc6-1065a3d9ed4c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:40 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Deleted allocations for instance 432cebf0-e35d-44fe-9224-ac7794472c5e
Aug 26 15:15:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-eca2cf26-c39b-45ec-92e5-4b30d1fc9619 tempest-VolumesNegativeTest-822202326 tempest-VolumesNegativeTest-822202326-project-member] Lock "432cebf0-e35d-44fe-9224-ac7794472c5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:42 user nova-compute[73052]: INFO nova.compute.manager [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Terminating instance
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received event network-vif-unplugged-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] Acquiring lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] No waiting events found dispatching network-vif-unplugged-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received event network-vif-unplugged-643da605-04c7-40ff-9de7-c5307f9efcaa for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received event network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] Acquiring lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] No waiting events found dispatching network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:15:42 user nova-compute[73052]: WARNING nova.compute.manager [req-b7a6b0a4-4125-48c7-9725-6eafe436f5c5 req-3a0dd637-ca3c-4cd8-9df6-49a01488a4c7 service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received unexpected event network-vif-plugged-643da605-04c7-40ff-9de7-c5307f9efcaa for instance with vm_state active and task_state deleting.
Aug 26 15:15:42 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Instance destroyed successfully.
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.objects.instance [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'resources' on Instance uuid dd55bbdc-8b92-462e-b8ee-b391314ac20c {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1122506762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1122506762',id=44,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:06:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-ryn9zl1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:08:16Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=dd55bbdc-8b92-462e-b8ee-b391314ac20c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "643da605-04c7-40ff-9de7-c5307f9efcaa", "address": "fa:16:3e:80:6a:33", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643da605-04", "ovs_interfaceid": "643da605-04c7-40ff-9de7-c5307f9efcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:6a:33,bridge_name='br-int',has_traffic_filtering=True,id=643da605-04c7-40ff-9de7-c5307f9efcaa,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643da605-04') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG os_vif [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:6a:33,bridge_name='br-int',has_traffic_filtering=True,id=643da605-04c7-40ff-9de7-c5307f9efcaa,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643da605-04') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap643da605-04, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:42 user nova-compute[73052]: INFO os_vif [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:6a:33,bridge_name='br-int',has_traffic_filtering=True,id=643da605-04c7-40ff-9de7-c5307f9efcaa,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643da605-04')
Aug 26 15:15:42 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Deleting instance files /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c_del
Aug 26 15:15:42 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Deletion of /opt/stack/data/nova/instances/dd55bbdc-8b92-462e-b8ee-b391314ac20c_del complete
Aug 26 15:15:42 user nova-compute[73052]: INFO nova.compute.manager [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 15:15:42 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:15:42 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:15:43 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:15:43 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Took 0.45 seconds to deallocate network for instance.
Aug 26 15:15:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:43 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:15:43 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:15:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:43 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Deleted allocations for instance dd55bbdc-8b92-462e-b8ee-b391314ac20c
Aug 26 15:15:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-8c618378-521c-4fbe-afde-5fe5e8317bb5 tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "dd55bbdc-8b92-462e-b8ee-b391314ac20c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.661s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-65bdc94c-e6c6-4cb3-8973-6eef239b2a2a req-75f588e3-6f33-4096-9f34-b885bb4bf80c service nova] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Received event network-vif-deleted-643da605-04c7-40ff-9de7-c5307f9efcaa {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Verify base images {{(pid=73052) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Image id a9d03ca9-51ef-4843-bf03-544c5298003b yields fingerprint 8f5144fad31c750b6b0f8224f385840c9ef37d3a {{(pid=73052) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 15:15:46 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] image a9d03ca9-51ef-4843-bf03-544c5298003b at (/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a): checking
Aug 26 15:15:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] image a9d03ca9-51ef-4843-bf03-544c5298003b at (/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a): image is in use {{(pid=73052) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73052) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] 8089746e-24d8-4792-a97b-62193a2ad808 is a valid instance name {{(pid=73052) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] 35013e14-c22c-439a-923f-61b1b98ce6b8 is a valid instance name {{(pid=73052) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] 35013e14-c22c-439a-923f-61b1b98ce6b8 has a disk file {{(pid=73052) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 15:15:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:15:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:15:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 is backed by 8f5144fad31c750b6b0f8224f385840c9ef37d3a {{(pid=73052) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc
Aug 26 15:15:47 user nova-compute[73052]: WARNING nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Unknown base file: /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Active base files: /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Removable base files: /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3 /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1 /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391 /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d2f3cfcfd007834e24183ba988208038fd30fb3
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/835718c448fa65f96c746d3225dcf30b697cc88c
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5b1b92b9effb6e13bd78df4d3f579ed8dd778be1
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/12dd48af2610761a05b8e6df0f59b36fc33fa5ce
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c965ba2a43d5d96dcb3b03ad64e9582adf85391
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7c88ea8d9f9d310fd3b2d723ff9227db2131837c
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d53d65365c7f677b8481925c3eee9a9b5c59f8aa
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/46aa67052a5f33fc06e7a8522f1c99807b04b8dc
Aug 26 15:15:47 user nova-compute[73052]: INFO nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b4f7a315aaba59d0d96f71a11b591632f917b3ab
Aug 26 15:15:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Verification complete {{(pid=73052) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 15:15:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Verify swap images {{(pid=73052) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 15:15:47 user nova-compute[73052]: DEBUG nova.virt.libvirt.imagecache [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Verify ephemeral images {{(pid=73052) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 15:15:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:15:54 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062939.2224298, 432cebf0-e35d-44fe-9224-ac7794472c5e => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:15:54 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] VM Stopped (Lifecycle Event)
Aug 26 15:15:54 user nova-compute[73052]: DEBUG nova.compute.manager [None req-6d01f26d-333a-4ce6-9e40-b84e13d9eab6 None None] [instance: 432cebf0-e35d-44fe-9224-ac7794472c5e] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:15:57 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062942.8633976, dd55bbdc-8b92-462e-b8ee-b391314ac20c => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:15:57 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] VM Stopped (Lifecycle Event)
Aug 26 15:15:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-290a507f-84b4-4c0c-bbc2-7ba8d5f253f6 None None] [instance: dd55bbdc-8b92-462e-b8ee-b391314ac20c] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:15:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 35013e14-c22c-439a-923f-61b1b98ce6b8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [{"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-35013e14-c22c-439a-923f-61b1b98ce6b8" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:16:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:16:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:16:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:16:25 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:25 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:28 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:16:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:16:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:16:29 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:16:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:16:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:30 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:16:30 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=25.02835464477539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 8089746e-24d8-4792-a97b-62193a2ad808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:16:30 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:16:31 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:16:31 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:16:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:16:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8089746e-24d8-4792-a97b-62193a2ad808" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:16:32 user nova-compute[73052]: INFO nova.compute.manager [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Terminating instance
Aug 26 15:16:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-32d6aa96-9510-4cc2-a262-978cf1842e0f req-5214dc4b-9e90-4c27-b33d-80cd6ac04018 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32d6aa96-9510-4cc2-a262-978cf1842e0f req-5214dc4b-9e90-4c27-b33d-80cd6ac04018 service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32d6aa96-9510-4cc2-a262-978cf1842e0f req-5214dc4b-9e90-4c27-b33d-80cd6ac04018 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-32d6aa96-9510-4cc2-a262-978cf1842e0f req-5214dc4b-9e90-4c27-b33d-80cd6ac04018 service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-32d6aa96-9510-4cc2-a262-978cf1842e0f req-5214dc4b-9e90-4c27-b33d-80cd6ac04018 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-32d6aa96-9510-4cc2-a262-978cf1842e0f req-5214dc4b-9e90-4c27-b33d-80cd6ac04018 service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-unplugged-96001862-3845-4236-8fb5-62a383e8141b for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Instance destroyed successfully.
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.objects.instance [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'resources' on Instance uuid 8089746e-24d8-4792-a97b-62193a2ad808 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1896647055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1896647055',id=41,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-ubl3jk5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:04:33Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=8089746e-24d8-4792-a97b-62193a2ad808,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "96001862-3845-4236-8fb5-62a383e8141b", "address": "fa:16:3e:e8:80:11", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96001862-38", "ovs_interfaceid": "96001862-3845-4236-8fb5-62a383e8141b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:80:11,bridge_name='br-int',has_traffic_filtering=True,id=96001862-3845-4236-8fb5-62a383e8141b,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96001862-38') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_vif [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:80:11,bridge_name='br-int',has_traffic_filtering=True,id=96001862-3845-4236-8fb5-62a383e8141b,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96001862-38') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96001862-38, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:16:33 user nova-compute[73052]: INFO os_vif [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:80:11,bridge_name='br-int',has_traffic_filtering=True,id=96001862-3845-4236-8fb5-62a383e8141b,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96001862-38')
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmYWiRxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:16:33 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4051de-2c01-4697-b848-1e30a2c1646f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e663763c-d566-4870-96f4-2193183a1c76]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:16:33 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b (non-flash)
Aug 26 15:16:33 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b'): ({'sdd'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Removing single pathed devices sdd {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a4ba48-4b79-4713-8664-08930c0df71f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5c3c23-6d3f-4656-a449-c6dfd0695a2e]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Flushing IO for device /dev/sdd {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61e9e66-4569-4c9a-ad7f-710d63926b99]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d1f3e8-0d32-4a90-bf68-88a0bba573f1]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] SCSI volumes sdd have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ece0cf6-fcdd-421c-a098-491c69b91074]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2536c66-c6fb-4aa3-ad45-0bfff08db86f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b, portal: 172.16.0.220,3260]
Aug 26 15:16:33 user nova-compute[73052]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b, portal: 172.16.0.220,3260] successful.
Aug 26 15:16:33 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d9c6c3-f7b6-4889-87db-24b32d362c2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[010124aa-5ba2-4b33-b246-f2809b4bafab]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] <== disconnect_volume: return (275ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:16:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Deleting instance files /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808_del
Aug 26 15:16:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Deletion of /opt/stack/data/nova/instances/8089746e-24d8-4792-a97b-62193a2ad808_del complete
Aug 26 15:16:33 user nova-compute[73052]: INFO nova.compute.manager [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 26 15:16:33 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:16:33 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:16:34 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:16:34 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Took 0.49 seconds to deallocate network for instance.
Aug 26 15:16:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-3d22137b-d0ac-4c89-82e9-ec9a324a09f8 req-7c618319-f377-43ee-88a7-4bb4234c8aca service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-deleted-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-7d299b79-37cf-423d-bd53-2f97fd989449 req-18b0351a-cc9e-4853-b8f7-dacbb4508e8f service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7d299b79-37cf-423d-bd53-2f97fd989449 req-18b0351a-cc9e-4853-b8f7-dacbb4508e8f service nova] Acquiring lock "8089746e-24d8-4792-a97b-62193a2ad808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7d299b79-37cf-423d-bd53-2f97fd989449 req-18b0351a-cc9e-4853-b8f7-dacbb4508e8f service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7d299b79-37cf-423d-bd53-2f97fd989449 req-18b0351a-cc9e-4853-b8f7-dacbb4508e8f service nova] Lock "8089746e-24d8-4792-a97b-62193a2ad808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-7d299b79-37cf-423d-bd53-2f97fd989449 req-18b0351a-cc9e-4853-b8f7-dacbb4508e8f service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] No waiting events found dispatching network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:16:35 user nova-compute[73052]: WARNING nova.compute.manager [req-7d299b79-37cf-423d-bd53-2f97fd989449 req-18b0351a-cc9e-4853-b8f7-dacbb4508e8f service nova] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Received unexpected event network-vif-plugged-96001862-3845-4236-8fb5-62a383e8141b for instance with vm_state active and task_state deleting.
Aug 26 15:16:35 user nova-compute[73052]: INFO nova.compute.manager [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Took 0.86 seconds to detach 1 volumes for instance.
Aug 26 15:16:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:16:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:16:35 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Deleted allocations for instance 8089746e-24d8-4792-a97b-62193a2ad808
Aug 26 15:16:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5cff7c36-6e69-4ec4-a7c1-b3619f2ded8f tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "8089746e-24d8-4792-a97b-62193a2ad808" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.939s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:16:38 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:38 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:16:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:16:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:16:44 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:48 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693062993.509058, 8089746e-24d8-4792-a97b-62193a2ad808 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:16:48 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] VM Stopped (Lifecycle Event)
Aug 26 15:16:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b3cde44-79ea-4e16-b09d-9e305295bbb5 None None] [instance: 8089746e-24d8-4792-a97b-62193a2ad808] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:16:48 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:16:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:16:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:16:58 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:18 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:20 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:17:20 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:17:23 user nova-compute[73052]: INFO nova.compute.manager [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Terminating instance
Aug 26 15:17:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-60e8d646-69d6-4c0c-9335-0291b4d50dae req-aa1d4333-98c1-4a88-b8af-1bc4fa2cc4f0 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received event network-vif-unplugged-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-60e8d646-69d6-4c0c-9335-0291b4d50dae req-aa1d4333-98c1-4a88-b8af-1bc4fa2cc4f0 service nova] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-60e8d646-69d6-4c0c-9335-0291b4d50dae req-aa1d4333-98c1-4a88-b8af-1bc4fa2cc4f0 service nova] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-60e8d646-69d6-4c0c-9335-0291b4d50dae req-aa1d4333-98c1-4a88-b8af-1bc4fa2cc4f0 service nova] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-60e8d646-69d6-4c0c-9335-0291b4d50dae req-aa1d4333-98c1-4a88-b8af-1bc4fa2cc4f0 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] No waiting events found dispatching network-vif-unplugged-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:17:23 user nova-compute[73052]: DEBUG nova.compute.manager [req-60e8d646-69d6-4c0c-9335-0291b4d50dae req-aa1d4333-98c1-4a88-b8af-1bc4fa2cc4f0 service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received event network-vif-unplugged-07a897a7-343c-42ba-a653-15bbcd053368 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:17:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Instance destroyed successfully.
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.objects.instance [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lazy-loading 'resources' on Instance uuid 35013e14-c22c-439a-923f-61b1b98ce6b8 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T14:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1171091425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1171091425',id=34,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T14:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7051da8614456b9334b146fa3581fd',ramdisk_id='',reservation_id='r-1lz8t7js',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-505611186',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T14:58:53Z,user_data=None,user_id='57f5f67238404fb9954260ad90a0a96d',uuid=35013e14-c22c-439a-923f-61b1b98ce6b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converting VIF {"id": "07a897a7-343c-42ba-a653-15bbcd053368", "address": "fa:16:3e:0a:fc:f3", "network": {"id": "630602ff-ca4e-4688-a49e-03009a84e3c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1318696595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7051da8614456b9334b146fa3581fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a897a7-34", "ovs_interfaceid": "07a897a7-343c-42ba-a653-15bbcd053368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:fc:f3,bridge_name='br-int',has_traffic_filtering=True,id=07a897a7-343c-42ba-a653-15bbcd053368,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a897a7-34') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG os_vif [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:fc:f3,bridge_name='br-int',has_traffic_filtering=True,id=07a897a7-343c-42ba-a653-15bbcd053368,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a897a7-34') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07a897a7-34, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:17:24 user nova-compute[73052]: INFO os_vif [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:fc:f3,bridge_name='br-int',has_traffic_filtering=True,id=07a897a7-343c-42ba-a653-15bbcd053368,network=Network(630602ff-ca4e-4688-a49e-03009a84e3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a897a7-34')
Aug 26 15:17:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Deleting instance files /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8_del
Aug 26 15:17:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Deletion of /opt/stack/data/nova/instances/35013e14-c22c-439a-923f-61b1b98ce6b8_del complete
Aug 26 15:17:24 user nova-compute[73052]: INFO nova.compute.manager [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:24 user nova-compute[73052]: WARNING nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] While synchronizing instance power states, found 1 instances in the database and 0 instances on the hypervisor.
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid 35013e14-c22c-439a-923f-61b1b98ce6b8 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-25bf7e24-a492-4365-8ba7-1d8837861746 req-ead1f861-4673-43ff-bd6b-040593b2feef service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received event network-vif-deleted-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:17:24 user nova-compute[73052]: INFO nova.compute.manager [req-25bf7e24-a492-4365-8ba7-1d8837861746 req-ead1f861-4673-43ff-bd6b-040593b2feef service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Neutron deleted interface 07a897a7-343c-42ba-a653-15bbcd053368; detaching it from the instance and deleting it from the info cache
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.network.neutron [req-25bf7e24-a492-4365-8ba7-1d8837861746 req-ead1f861-4673-43ff-bd6b-040593b2feef service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:17:24 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Took 0.46 seconds to deallocate network for instance.
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.compute.manager [req-25bf7e24-a492-4365-8ba7-1d8837861746 req-ead1f861-4673-43ff-bd6b-040593b2feef service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Detach interface failed, port_id=07a897a7-343c-42ba-a653-15bbcd053368, reason: Instance 35013e14-c22c-439a-923f-61b1b98ce6b8 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:17:24 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Deleted allocations for instance 35013e14-c22c-439a-923f-61b1b98ce6b8
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-435543af-c7fd-4964-8ca5-4034df03d23c tempest-ServerBootFromVolumeStableRescueTest-505611186 tempest-ServerBootFromVolumeStableRescueTest-505611186-project-member] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.615s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.675s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:17:24 user nova-compute[73052]: INFO nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 26 15:17:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:17:25 user nova-compute[73052]: DEBUG nova.compute.manager [req-61f38452-0de5-4c88-ae7d-b8dc84d5c7b2 req-831bc1a2-7c82-4786-8a9b-8c04b9968a9f service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received event network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:17:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-61f38452-0de5-4c88-ae7d-b8dc84d5c7b2 req-831bc1a2-7c82-4786-8a9b-8c04b9968a9f service nova] Acquiring lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:17:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-61f38452-0de5-4c88-ae7d-b8dc84d5c7b2 req-831bc1a2-7c82-4786-8a9b-8c04b9968a9f service nova] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:17:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-61f38452-0de5-4c88-ae7d-b8dc84d5c7b2 req-831bc1a2-7c82-4786-8a9b-8c04b9968a9f service nova] Lock "35013e14-c22c-439a-923f-61b1b98ce6b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:17:25 user nova-compute[73052]: DEBUG nova.compute.manager [req-61f38452-0de5-4c88-ae7d-b8dc84d5c7b2 req-831bc1a2-7c82-4786-8a9b-8c04b9968a9f service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] No waiting events found dispatching network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:17:25 user nova-compute[73052]: WARNING nova.compute.manager [req-61f38452-0de5-4c88-ae7d-b8dc84d5c7b2 req-831bc1a2-7c82-4786-8a9b-8c04b9968a9f service nova] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Received unexpected event network-vif-plugged-07a897a7-343c-42ba-a653-15bbcd053368 for instance with vm_state deleted and task_state None.
Aug 26 15:17:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:28 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:30 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:17:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:17:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:17:30 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:17:31 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:17:31 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:17:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8903MB free_disk=25.143905639648438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:17:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:17:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:17:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:17:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:17:31 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:17:31 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:17:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:17:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:17:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:17:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:17:39 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693063044.1476765, 35013e14-c22c-439a-923f-61b1b98ce6b8 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:17:39 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] VM Stopped (Lifecycle Event)
Aug 26 15:17:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fd1f0f3e-0569-4e45-8944-e51e0219f50b None None] [instance: 35013e14-c22c-439a-923f-61b1b98ce6b8] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:17:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:17:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:17:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:17:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:17:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:17:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:17:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:17:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:17:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:17:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:17:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:18:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:18:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:21 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:18:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:18:21 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:18:23 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:18:28 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:18:29 user nova-compute[73052]: INFO nova.compute.claims [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Claim successful on node user
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.177s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:18:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.policy [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c10396c807443083b436339dbb932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdfc74b3d74cc09c18b16504341125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:18:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Creating image(s)
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "/opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "/opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "/opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.192s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk 1073741824" returned: 0 in 0.065s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG nova.network.neutron [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Successfully created port: 23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.195s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Cannot resize image /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Ensure instance console log exists: /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:18:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Successfully updated port: 23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-9dba6a8a-4620-49f7-a5c4-46fcb675610e req-6fc62e9f-d0f3-4fde-b593-4dc30a86d732 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received event network-changed-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-9dba6a8a-4620-49f7-a5c4-46fcb675610e req-6fc62e9f-d0f3-4fde-b593-4dc30a86d732 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Refreshing instance network info cache due to event network-changed-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9dba6a8a-4620-49f7-a5c4-46fcb675610e req-6fc62e9f-d0f3-4fde-b593-4dc30a86d732 service nova] Acquiring lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9dba6a8a-4620-49f7-a5c4-46fcb675610e req-6fc62e9f-d0f3-4fde-b593-4dc30a86d732 service nova] Acquired lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-9dba6a8a-4620-49f7-a5c4-46fcb675610e req-6fc62e9f-d0f3-4fde-b593-4dc30a86d732 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Refreshing network info cache for port 23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:18:31 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:18:31 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.141345977783203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-9dba6a8a-4620-49f7-a5c4-46fcb675610e req-6fc62e9f-d0f3-4fde-b593-4dc30a86d732 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4671dc51-c939-47a0-88d3-f20a7fe61133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-9dba6a8a-4620-49f7-a5c4-46fcb675610e req-6fc62e9f-d0f3-4fde-b593-4dc30a86d732 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-9dba6a8a-4620-49f7-a5c4-46fcb675610e req-6fc62e9f-d0f3-4fde-b593-4dc30a86d732 service nova] Releasing lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquired lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:18:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [{"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Releasing lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Instance network_info: |[{"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Start _get_guest_xml network_info=[{"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:18:32 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:18:32 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-381940687',display_name='tempest-AttachVolumeNegativeTest-server-381940687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-381940687',id=48,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlPErZSE4kpPFeXD3Z494JPQLIfGAXh/L+RdU9ykFAE+6zJL6vgbC+5PTsy8V8U4fHHgYk8tP5+DKch+i8i3wlkUjdqtQBMftjVTxa4p677zae3+lIXPS/BAiXecklbbg==',key_name='tempest-keypair-578419611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-vcqxnbmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:18:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=4671dc51-c939-47a0-88d3-f20a7fe61133,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:47:ad,bridge_name='br-int',has_traffic_filtering=True,id=23c2bda4-64bd-49c4-8b66-69bbd0ccfb41,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c2bda4-64') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'pci_devices' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:18:32 user nova-compute[73052]:   <uuid>4671dc51-c939-47a0-88d3-f20a7fe61133</uuid>
Aug 26 15:18:32 user nova-compute[73052]:   <name>instance-00000030</name>
Aug 26 15:18:32 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:18:32 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:18:32 user nova-compute[73052]:   <metadata>
Aug 26 15:18:32 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:18:32 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:18:32 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeNegativeTest-server-381940687</nova:name>
Aug 26 15:18:32 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:18:32</nova:creationTime>
Aug 26 15:18:32 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:18:32 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:18:32 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:18:32 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:18:32 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:18:32 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:18:32 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:18:32 user nova-compute[73052]:       <nova:owner>
Aug 26 15:18:32 user nova-compute[73052]:         <nova:user uuid="36c10396c807443083b436339dbb932a">tempest-AttachVolumeNegativeTest-1607008473-project-member</nova:user>
Aug 26 15:18:32 user nova-compute[73052]:         <nova:project uuid="cfbdfc74b3d74cc09c18b16504341125">tempest-AttachVolumeNegativeTest-1607008473</nova:project>
Aug 26 15:18:32 user nova-compute[73052]:       </nova:owner>
Aug 26 15:18:32 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:18:32 user nova-compute[73052]:       <nova:ports>
Aug 26 15:18:32 user nova-compute[73052]:         <nova:port uuid="23c2bda4-64bd-49c4-8b66-69bbd0ccfb41">
Aug 26 15:18:32 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 15:18:32 user nova-compute[73052]:         </nova:port>
Aug 26 15:18:32 user nova-compute[73052]:       </nova:ports>
Aug 26 15:18:32 user nova-compute[73052]:     </nova:instance>
Aug 26 15:18:32 user nova-compute[73052]:   </metadata>
Aug 26 15:18:32 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:18:32 user nova-compute[73052]:     <system>
Aug 26 15:18:32 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:18:32 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:18:32 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:18:32 user nova-compute[73052]:       <entry name="serial">4671dc51-c939-47a0-88d3-f20a7fe61133</entry>
Aug 26 15:18:32 user nova-compute[73052]:       <entry name="uuid">4671dc51-c939-47a0-88d3-f20a7fe61133</entry>
Aug 26 15:18:32 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:18:32 user nova-compute[73052]:     </system>
Aug 26 15:18:32 user nova-compute[73052]:   </sysinfo>
Aug 26 15:18:32 user nova-compute[73052]:   <os>
Aug 26 15:18:32 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:18:32 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:18:32 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:18:32 user nova-compute[73052]:   </os>
Aug 26 15:18:32 user nova-compute[73052]:   <features>
Aug 26 15:18:32 user nova-compute[73052]:     <acpi/>
Aug 26 15:18:32 user nova-compute[73052]:     <apic/>
Aug 26 15:18:32 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:18:32 user nova-compute[73052]:   </features>
Aug 26 15:18:32 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:18:32 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:18:32 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:18:32 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:18:32 user nova-compute[73052]:   </clock>
Aug 26 15:18:32 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:18:32 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:18:32 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:18:32 user nova-compute[73052]:   </cpu>
Aug 26 15:18:32 user nova-compute[73052]:   <devices>
Aug 26 15:18:32 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:18:32 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:18:32 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk"/>
Aug 26 15:18:32 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:18:32 user nova-compute[73052]:     </disk>
Aug 26 15:18:32 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:18:32 user nova-compute[73052]:       <mac address="fa:16:3e:eb:47:ad"/>
Aug 26 15:18:32 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:18:32 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:18:32 user nova-compute[73052]:       <target dev="tap23c2bda4-64"/>
Aug 26 15:18:32 user nova-compute[73052]:     </interface>
Aug 26 15:18:32 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:18:32 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/console.log" append="off"/>
Aug 26 15:18:32 user nova-compute[73052]:     </serial>
Aug 26 15:18:32 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:18:32 user nova-compute[73052]:     <video>
Aug 26 15:18:32 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:18:32 user nova-compute[73052]:     </video>
Aug 26 15:18:32 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:18:32 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:18:32 user nova-compute[73052]:     </rng>
Aug 26 15:18:32 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:18:32 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:18:32 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:18:32 user nova-compute[73052]:     </memballoon>
Aug 26 15:18:32 user nova-compute[73052]:   </devices>
Aug 26 15:18:32 user nova-compute[73052]: </domain>
Aug 26 15:18:32 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-381940687',display_name='tempest-AttachVolumeNegativeTest-server-381940687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-381940687',id=48,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlPErZSE4kpPFeXD3Z494JPQLIfGAXh/L+RdU9ykFAE+6zJL6vgbC+5PTsy8V8U4fHHgYk8tP5+DKch+i8i3wlkUjdqtQBMftjVTxa4p677zae3+lIXPS/BAiXecklbbg==',key_name='tempest-keypair-578419611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-vcqxnbmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:18:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=4671dc51-c939-47a0-88d3-f20a7fe61133,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:47:ad,bridge_name='br-int',has_traffic_filtering=True,id=23c2bda4-64bd-49c4-8b66-69bbd0ccfb41,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c2bda4-64') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG os_vif [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:47:ad,bridge_name='br-int',has_traffic_filtering=True,id=23c2bda4-64bd-49c4-8b66-69bbd0ccfb41,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c2bda4-64') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23c2bda4-64, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23c2bda4-64, col_values=(('external_ids', {'iface-id': '23c2bda4-64bd-49c4-8b66-69bbd0ccfb41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:47:ad', 'vm-uuid': '4671dc51-c939-47a0-88d3-f20a7fe61133'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:32 user nova-compute[73052]: INFO os_vif [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:47:ad,bridge_name='br-int',has_traffic_filtering=True,id=23c2bda4-64bd-49c4-8b66-69bbd0ccfb41,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c2bda4-64')
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No VIF found with MAC fa:16:3e:eb:47:ad, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-7e93a37f-cd73-403d-ba4d-e85f3254dbbb req-146f088a-9e85-420d-b6ab-1431873c3f1a service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received event network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:18:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7e93a37f-cd73-403d-ba4d-e85f3254dbbb req-146f088a-9e85-420d-b6ab-1431873c3f1a service nova] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7e93a37f-cd73-403d-ba4d-e85f3254dbbb req-146f088a-9e85-420d-b6ab-1431873c3f1a service nova] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7e93a37f-cd73-403d-ba4d-e85f3254dbbb req-146f088a-9e85-420d-b6ab-1431873c3f1a service nova] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-7e93a37f-cd73-403d-ba4d-e85f3254dbbb req-146f088a-9e85-420d-b6ab-1431873c3f1a service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] No waiting events found dispatching network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:18:33 user nova-compute[73052]: WARNING nova.compute.manager [req-7e93a37f-cd73-403d-ba4d-e85f3254dbbb req-146f088a-9e85-420d-b6ab-1431873c3f1a service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received unexpected event network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 for instance with vm_state building and task_state spawning.
Aug 26 15:18:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693063115.6165397, 4671dc51-c939-47a0-88d3-f20a7fe61133 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:18:35 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] VM Resumed (Lifecycle Event)
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:18:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Instance spawned successfully.
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:18:35 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693063115.6175919, 4671dc51-c939-47a0-88d3-f20a7fe61133 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:18:35 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] VM Started (Lifecycle Event)
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:18:35 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:18:35 user nova-compute[73052]: INFO nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-dba6d76b-8843-41bf-b2ec-335d3664e64a req-76673851-7a05-4490-8907-3e731f25d93f service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received event network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dba6d76b-8843-41bf-b2ec-335d3664e64a req-76673851-7a05-4490-8907-3e731f25d93f service nova] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dba6d76b-8843-41bf-b2ec-335d3664e64a req-76673851-7a05-4490-8907-3e731f25d93f service nova] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dba6d76b-8843-41bf-b2ec-335d3664e64a req-76673851-7a05-4490-8907-3e731f25d93f service nova] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-dba6d76b-8843-41bf-b2ec-335d3664e64a req-76673851-7a05-4490-8907-3e731f25d93f service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] No waiting events found dispatching network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:18:35 user nova-compute[73052]: WARNING nova.compute.manager [req-dba6d76b-8843-41bf-b2ec-335d3664e64a req-76673851-7a05-4490-8907-3e731f25d93f service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received unexpected event network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 for instance with vm_state building and task_state spawning.
Aug 26 15:18:35 user nova-compute[73052]: INFO nova.compute.manager [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Took 6.57 seconds to build instance.
Aug 26 15:18:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-9d8bdfcd-ac44-42bf-b52b-c3b239bd53f5 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.665s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:18:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:18:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:18:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:19:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:22 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:19:22 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:19:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:19:22 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:19:22 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:19:22 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:19:23 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [{"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:19:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:19:23 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:19:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:19:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:19:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:31 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:19:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:19:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:19:32 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:19:32 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:19:33 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:19:33 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:19:33 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.112274169921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4671dc51-c939-47a0-88d3-f20a7fe61133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:19:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:19:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:19:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:19:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:19:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:19:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:20:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:20:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:20:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-010f3150-15ae-41c1-9366-be940176124a req-5ca79fec-fa8f-44f1-9317-5bcda2694969 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received event network-changed-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG nova.compute.manager [req-010f3150-15ae-41c1-9366-be940176124a req-5ca79fec-fa8f-44f1-9317-5bcda2694969 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Refreshing instance network info cache due to event network-changed-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-010f3150-15ae-41c1-9366-be940176124a req-5ca79fec-fa8f-44f1-9317-5bcda2694969 service nova] Acquiring lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-010f3150-15ae-41c1-9366-be940176124a req-5ca79fec-fa8f-44f1-9317-5bcda2694969 service nova] Acquired lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-010f3150-15ae-41c1-9366-be940176124a req-5ca79fec-fa8f-44f1-9317-5bcda2694969 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Refreshing network info cache for port 23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-010f3150-15ae-41c1-9366-be940176124a req-5ca79fec-fa8f-44f1-9317-5bcda2694969 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updated VIF entry in instance network info cache for port 23c2bda4-64bd-49c4-8b66-69bbd0ccfb41. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG nova.network.neutron [req-010f3150-15ae-41c1-9366-be940176124a req-5ca79fec-fa8f-44f1-9317-5bcda2694969 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [{"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-010f3150-15ae-41c1-9366-be940176124a req-5ca79fec-fa8f-44f1-9317-5bcda2694969 service nova] Releasing lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:20:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG nova.objects.instance [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:24 user nova-compute[73052]: INFO nova.compute.manager [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Attaching volume 215b39ea-f382-4e9f-9f06-7957a0e5f23b to /dev/vdb
Aug 26 15:20:24 user nova-compute[73052]: DEBUG os_brick.utils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a878a2-5cd3-4a80-9a00-e5d5424352c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81b5cf9-f848-41ad-88d7-7643df8b84bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b40122-1e6d-4cc9-bb92-a0ec0b8aa9c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeee7e61-9e16-400c-b69a-1ddca4d33f93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:20:24 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c8d5f-0ffd-40fc-a565-e7a836cb7715]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG os_brick.utils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating existing volume attachment record: d232b6d7-ea8b-434e-853b-8d81c7132a23 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:20:24 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:20:25 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [{"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:20:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:20:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:20:25 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:20:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:20:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oipXaHVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:20:34 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:20:34 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:20:34 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:20:34 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:20:34 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=25.111408233642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be612c9-0b7a-4f18-b5e9-187043df45c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:20:34 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac6b4d-91bd-4f96-bf0e-2fb0028e111e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b] added
Aug 26 15:20:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d59f83-f6a2-4a0a-b9fe-d9041417b434]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4671dc51-c939-47a0-88d3-f20a7fe61133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedf3688-1871-4b58-b96a-e3de2c98f022]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oipXaHVz {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oipXaHVz" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[564b304a-5178-43a8-9173-4a2a8c6d0641]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oipXaHVz'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e883e7a5-4c67-44c9-8df9-cd7926facef2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8c7b4-762c-40a8-a428-d9393705bf15]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:20:34 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:20:34 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:20:34 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:20:34 user nova-compute[73052]: 
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ce9e6-cdfb-4c23-a381-022df4ff4890]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b, portal: 172.16.0.220,3260]
Aug 26 15:20:34 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b, portal: 172.16.0.220,3260] successful.
Aug 26 15:20:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[170337a7-38ba-44d2-ae51-bc5938a2e80c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9fca23-760e-4c85-a7a8-fec7110acac0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b (non-flash)
Aug 26 15:20:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b (non-flash)
Aug 26 15:20:34 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:20:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafc103b-b589-43ed-8b29-6a34d96c90b0]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:20:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:20:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oipXaHVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23137643866633161', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137643866633161', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG nova.objects.instance [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:20:36 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:20:36 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:20:36 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:20:36 user nova-compute[73052]:   <serial>215b39ea-f382-4e9f-9f06-7957a0e5f23b</serial>
Aug 26 15:20:36 user nova-compute[73052]: </disk>
Aug 26 15:20:36 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No VIF found with MAC fa:16:3e:eb:47:ad, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:20:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-6f822c4a-ef7b-4e7b-a276-e529f4712155 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.292s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:20:40 user nova-compute[73052]: INFO nova.compute.claims [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Claim successful on node user
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:20:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.policy [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c10396c807443083b436339dbb932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdfc74b3d74cc09c18b16504341125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:20:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Creating image(s)
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "/opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "/opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk 1073741824" returned: 0 in 0.056s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Successfully created port: c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.169s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Cannot resize image /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Ensure instance console log exists: /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Successfully updated port: c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquired lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-39eae873-aee2-4fb6-a302-805e35c7bbd6 req-78a10a95-37f8-4a1f-a648-cca5d6f897f0 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-changed-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.compute.manager [req-39eae873-aee2-4fb6-a302-805e35c7bbd6 req-78a10a95-37f8-4a1f-a648-cca5d6f897f0 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Refreshing instance network info cache due to event network-changed-c13d631c-e4c8-488f-9016-c064a98cdad7. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-39eae873-aee2-4fb6-a302-805e35c7bbd6 req-78a10a95-37f8-4a1f-a648-cca5d6f897f0 service nova] Acquiring lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.neutron [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updating instance_info_cache with network_info: [{"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Releasing lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Instance network_info: |[{"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-39eae873-aee2-4fb6-a302-805e35c7bbd6 req-78a10a95-37f8-4a1f-a648-cca5d6f897f0 service nova] Acquired lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-39eae873-aee2-4fb6-a302-805e35c7bbd6 req-78a10a95-37f8-4a1f-a648-cca5d6f897f0 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Refreshing network info cache for port c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Start _get_guest_xml network_info=[{"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:20:42 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:20:42 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758404813',display_name='tempest-AttachVolumeNegativeTest-server-1758404813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758404813',id=49,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJADmYBDYibmnqlFHfz/TB4OY6Izpi8jYx2j46uz68qLtI/Or+xyvHXUR3BCJSrdHmv7Nqy3J0F7XY7Xl0T5kxb8SBQXxcChgfJ/K6PUIuqfK+gaFJvdcTnWxPxoLInXtg==',key_name='tempest-keypair-472815923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-16s0koiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:02:78,bridge_name='br-int',has_traffic_filtering=True,id=c13d631c-e4c8-488f-9016-c064a98cdad7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc13d631c-e4') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.objects.instance [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'pci_devices' on Instance uuid bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:20:42 user nova-compute[73052]:   <uuid>bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3</uuid>
Aug 26 15:20:42 user nova-compute[73052]:   <name>instance-00000031</name>
Aug 26 15:20:42 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:20:42 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:20:42 user nova-compute[73052]:   <metadata>
Aug 26 15:20:42 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:20:42 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:20:42 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1758404813</nova:name>
Aug 26 15:20:42 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:20:42</nova:creationTime>
Aug 26 15:20:42 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:20:42 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:20:42 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:20:42 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:20:42 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:20:42 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:20:42 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:20:42 user nova-compute[73052]:       <nova:owner>
Aug 26 15:20:42 user nova-compute[73052]:         <nova:user uuid="36c10396c807443083b436339dbb932a">tempest-AttachVolumeNegativeTest-1607008473-project-member</nova:user>
Aug 26 15:20:42 user nova-compute[73052]:         <nova:project uuid="cfbdfc74b3d74cc09c18b16504341125">tempest-AttachVolumeNegativeTest-1607008473</nova:project>
Aug 26 15:20:42 user nova-compute[73052]:       </nova:owner>
Aug 26 15:20:42 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:20:42 user nova-compute[73052]:       <nova:ports>
Aug 26 15:20:42 user nova-compute[73052]:         <nova:port uuid="c13d631c-e4c8-488f-9016-c064a98cdad7">
Aug 26 15:20:42 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 15:20:42 user nova-compute[73052]:         </nova:port>
Aug 26 15:20:42 user nova-compute[73052]:       </nova:ports>
Aug 26 15:20:42 user nova-compute[73052]:     </nova:instance>
Aug 26 15:20:42 user nova-compute[73052]:   </metadata>
Aug 26 15:20:42 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:20:42 user nova-compute[73052]:     <system>
Aug 26 15:20:42 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:20:42 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:20:42 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:20:42 user nova-compute[73052]:       <entry name="serial">bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3</entry>
Aug 26 15:20:42 user nova-compute[73052]:       <entry name="uuid">bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3</entry>
Aug 26 15:20:42 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:20:42 user nova-compute[73052]:     </system>
Aug 26 15:20:42 user nova-compute[73052]:   </sysinfo>
Aug 26 15:20:42 user nova-compute[73052]:   <os>
Aug 26 15:20:42 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:20:42 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:20:42 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:20:42 user nova-compute[73052]:   </os>
Aug 26 15:20:42 user nova-compute[73052]:   <features>
Aug 26 15:20:42 user nova-compute[73052]:     <acpi/>
Aug 26 15:20:42 user nova-compute[73052]:     <apic/>
Aug 26 15:20:42 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:20:42 user nova-compute[73052]:   </features>
Aug 26 15:20:42 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:20:42 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:20:42 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:20:42 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:20:42 user nova-compute[73052]:   </clock>
Aug 26 15:20:42 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:20:42 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:20:42 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:20:42 user nova-compute[73052]:   </cpu>
Aug 26 15:20:42 user nova-compute[73052]:   <devices>
Aug 26 15:20:42 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:20:42 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:20:42 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk"/>
Aug 26 15:20:42 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:20:42 user nova-compute[73052]:     </disk>
Aug 26 15:20:42 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:20:42 user nova-compute[73052]:       <mac address="fa:16:3e:2a:02:78"/>
Aug 26 15:20:42 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:20:42 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:20:42 user nova-compute[73052]:       <target dev="tapc13d631c-e4"/>
Aug 26 15:20:42 user nova-compute[73052]:     </interface>
Aug 26 15:20:42 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:20:42 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/console.log" append="off"/>
Aug 26 15:20:42 user nova-compute[73052]:     </serial>
Aug 26 15:20:42 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:20:42 user nova-compute[73052]:     <video>
Aug 26 15:20:42 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:20:42 user nova-compute[73052]:     </video>
Aug 26 15:20:42 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:20:42 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:20:42 user nova-compute[73052]:     </rng>
Aug 26 15:20:42 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:20:42 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:20:42 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:20:42 user nova-compute[73052]:     </memballoon>
Aug 26 15:20:42 user nova-compute[73052]:   </devices>
Aug 26 15:20:42 user nova-compute[73052]: </domain>
Aug 26 15:20:42 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758404813',display_name='tempest-AttachVolumeNegativeTest-server-1758404813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758404813',id=49,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJADmYBDYibmnqlFHfz/TB4OY6Izpi8jYx2j46uz68qLtI/Or+xyvHXUR3BCJSrdHmv7Nqy3J0F7XY7Xl0T5kxb8SBQXxcChgfJ/K6PUIuqfK+gaFJvdcTnWxPxoLInXtg==',key_name='tempest-keypair-472815923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-16s0koiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:02:78,bridge_name='br-int',has_traffic_filtering=True,id=c13d631c-e4c8-488f-9016-c064a98cdad7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc13d631c-e4') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG os_vif [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:02:78,bridge_name='br-int',has_traffic_filtering=True,id=c13d631c-e4c8-488f-9016-c064a98cdad7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc13d631c-e4') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc13d631c-e4, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc13d631c-e4, col_values=(('external_ids', {'iface-id': 'c13d631c-e4c8-488f-9016-c064a98cdad7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:02:78', 'vm-uuid': 'bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:42 user nova-compute[73052]: INFO os_vif [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:02:78,bridge_name='br-int',has_traffic_filtering=True,id=c13d631c-e4c8-488f-9016-c064a98cdad7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc13d631c-e4')
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No VIF found with MAC fa:16:3e:2a:02:78, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-39eae873-aee2-4fb6-a302-805e35c7bbd6 req-78a10a95-37f8-4a1f-a648-cca5d6f897f0 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updated VIF entry in instance network info cache for port c13d631c-e4c8-488f-9016-c064a98cdad7. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG nova.network.neutron [req-39eae873-aee2-4fb6-a302-805e35c7bbd6 req-78a10a95-37f8-4a1f-a648-cca5d6f897f0 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updating instance_info_cache with network_info: [{"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:20:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-39eae873-aee2-4fb6-a302-805e35c7bbd6 req-78a10a95-37f8-4a1f-a648-cca5d6f897f0 service nova] Releasing lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:20:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:43 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-5fd1ecec-81d5-4644-bcc0-d554a906f467 req-7bbe699a-048e-4d12-a496-f5d7dccb0538 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:20:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5fd1ecec-81d5-4644-bcc0-d554a906f467 req-7bbe699a-048e-4d12-a496-f5d7dccb0538 service nova] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5fd1ecec-81d5-4644-bcc0-d554a906f467 req-7bbe699a-048e-4d12-a496-f5d7dccb0538 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-5fd1ecec-81d5-4644-bcc0-d554a906f467 req-7bbe699a-048e-4d12-a496-f5d7dccb0538 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:44 user nova-compute[73052]: DEBUG nova.compute.manager [req-5fd1ecec-81d5-4644-bcc0-d554a906f467 req-7bbe699a-048e-4d12-a496-f5d7dccb0538 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] No waiting events found dispatching network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:20:44 user nova-compute[73052]: WARNING nova.compute.manager [req-5fd1ecec-81d5-4644-bcc0-d554a906f467 req-7bbe699a-048e-4d12-a496-f5d7dccb0538 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received unexpected event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 for instance with vm_state building and task_state spawning.
Aug 26 15:20:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693063246.0744328, bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:20:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] VM Resumed (Lifecycle Event)
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:20:46 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Instance spawned successfully.
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:20:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693063246.076122, bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:20:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] VM Started (Lifecycle Event)
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:20:46 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:20:46 user nova-compute[73052]: INFO nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-f0aee073-28c8-4b9c-b0b3-5ef56928f623 req-458228f7-0d52-439f-a85b-0111dc07b6b3 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f0aee073-28c8-4b9c-b0b3-5ef56928f623 req-458228f7-0d52-439f-a85b-0111dc07b6b3 service nova] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f0aee073-28c8-4b9c-b0b3-5ef56928f623 req-458228f7-0d52-439f-a85b-0111dc07b6b3 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f0aee073-28c8-4b9c-b0b3-5ef56928f623 req-458228f7-0d52-439f-a85b-0111dc07b6b3 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:46 user nova-compute[73052]: DEBUG nova.compute.manager [req-f0aee073-28c8-4b9c-b0b3-5ef56928f623 req-458228f7-0d52-439f-a85b-0111dc07b6b3 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] No waiting events found dispatching network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:20:46 user nova-compute[73052]: WARNING nova.compute.manager [req-f0aee073-28c8-4b9c-b0b3-5ef56928f623 req-458228f7-0d52-439f-a85b-0111dc07b6b3 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received unexpected event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 for instance with vm_state building and task_state spawning.
Aug 26 15:20:46 user nova-compute[73052]: INFO nova.compute.manager [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Took 6.06 seconds to build instance.
Aug 26 15:20:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-bd833ad1-0238-4fd4-a336-746d57b3df7f tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.150s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:20:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:20:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:20:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:20:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:21:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:21:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:21:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:21:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:21:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:21:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:21:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:21:26 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:21:26 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:21:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [{"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:21:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:21:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:21:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:21:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:21:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:21:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:21:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:21:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:21:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:21:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:21:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:21:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:21:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:21:36 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:21:37 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:21:37 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.081748962402344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4671dc51-c939-47a0-88d3-f20a7fe61133 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:21:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:21:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:21:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:21:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:21:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:21:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:21:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:21:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:21:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:21:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:21:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:21:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:21:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:21:56 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:21:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:21:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:21:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:21:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:21:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:21:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:22:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:22:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:22:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:22:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:22:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updating instance_info_cache with network_info: [{"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:22:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:22:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:22:28 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:22:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:30 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-d6ba6058-0e12-4e7b-9fd4-9d9d190acb2d req-22aca0cb-3cb2-402e-b3ce-dceeda8f7729 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-changed-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG nova.compute.manager [req-d6ba6058-0e12-4e7b-9fd4-9d9d190acb2d req-22aca0cb-3cb2-402e-b3ce-dceeda8f7729 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Refreshing instance network info cache due to event network-changed-c13d631c-e4c8-488f-9016-c064a98cdad7. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d6ba6058-0e12-4e7b-9fd4-9d9d190acb2d req-22aca0cb-3cb2-402e-b3ce-dceeda8f7729 service nova] Acquiring lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d6ba6058-0e12-4e7b-9fd4-9d9d190acb2d req-22aca0cb-3cb2-402e-b3ce-dceeda8f7729 service nova] Acquired lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG nova.network.neutron [req-d6ba6058-0e12-4e7b-9fd4-9d9d190acb2d req-22aca0cb-3cb2-402e-b3ce-dceeda8f7729 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Refreshing network info cache for port c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:31 user nova-compute[73052]: INFO nova.compute.manager [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Terminating instance
Aug 26 15:22:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG nova.network.neutron [req-d6ba6058-0e12-4e7b-9fd4-9d9d190acb2d req-22aca0cb-3cb2-402e-b3ce-dceeda8f7729 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updated VIF entry in instance network info cache for port c13d631c-e4c8-488f-9016-c064a98cdad7. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG nova.network.neutron [req-d6ba6058-0e12-4e7b-9fd4-9d9d190acb2d req-22aca0cb-3cb2-402e-b3ce-dceeda8f7729 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updating instance_info_cache with network_info: [{"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-d6ba6058-0e12-4e7b-9fd4-9d9d190acb2d req-22aca0cb-3cb2-402e-b3ce-dceeda8f7729 service nova] Releasing lock "refresh_cache-bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Instance destroyed successfully.
Aug 26 15:22:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'resources' on Instance uuid bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758404813',display_name='tempest-AttachVolumeNegativeTest-server-1758404813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758404813',id=49,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJADmYBDYibmnqlFHfz/TB4OY6Izpi8jYx2j46uz68qLtI/Or+xyvHXUR3BCJSrdHmv7Nqy3J0F7XY7Xl0T5kxb8SBQXxcChgfJ/K6PUIuqfK+gaFJvdcTnWxPxoLInXtg==',key_name='tempest-keypair-472815923',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-16s0koiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "c13d631c-e4c8-488f-9016-c064a98cdad7", "address": "fa:16:3e:2a:02:78", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc13d631c-e4", "ovs_interfaceid": "c13d631c-e4c8-488f-9016-c064a98cdad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:02:78,bridge_name='br-int',has_traffic_filtering=True,id=c13d631c-e4c8-488f-9016-c064a98cdad7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc13d631c-e4') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG os_vif [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:02:78,bridge_name='br-int',has_traffic_filtering=True,id=c13d631c-e4c8-488f-9016-c064a98cdad7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc13d631c-e4') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc13d631c-e4, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: INFO os_vif [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:02:78,bridge_name='br-int',has_traffic_filtering=True,id=c13d631c-e4c8-488f-9016-c064a98cdad7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc13d631c-e4')
Aug 26 15:22:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Deleting instance files /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3_del
Aug 26 15:22:32 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Deletion of /opt/stack/data/nova/instances/bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3_del complete
Aug 26 15:22:32 user nova-compute[73052]: INFO nova.compute.manager [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 15:22:32 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-unplugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] No waiting events found dispatching network-vif-unplugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-unplugged-c13d631c-e4c8-488f-9016-c064a98cdad7 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] No waiting events found dispatching network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:22:33 user nova-compute[73052]: WARNING nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received unexpected event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 for instance with vm_state active and task_state deleting.
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] No waiting events found dispatching network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:22:33 user nova-compute[73052]: WARNING nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received unexpected event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 for instance with vm_state active and task_state deleting.
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] No waiting events found dispatching network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:22:33 user nova-compute[73052]: WARNING nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received unexpected event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 for instance with vm_state active and task_state deleting.
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-unplugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] No waiting events found dispatching network-vif-unplugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-unplugged-c13d631c-e4c8-488f-9016-c064a98cdad7 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Acquiring lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] No waiting events found dispatching network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:22:33 user nova-compute[73052]: WARNING nova.compute.manager [req-c85edc31-6701-4692-92df-c7175d41522c req-b9432e89-1865-451a-9d41-bd16b4f5ae59 service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received unexpected event network-vif-plugged-c13d631c-e4c8-488f-9016-c064a98cdad7 for instance with vm_state active and task_state deleting.
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:22:33 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Took 0.94 seconds to deallocate network for instance.
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-ad33c684-ec9a-4a36-a5d6-bf4d87d6d02c req-613d32f8-7474-4fcd-8a7b-08249cd4163e service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Received event network-vif-deleted-c13d631c-e4c8-488f-9016-c064a98cdad7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:22:33 user nova-compute[73052]: INFO nova.compute.manager [req-ad33c684-ec9a-4a36-a5d6-bf4d87d6d02c req-613d32f8-7474-4fcd-8a7b-08249cd4163e service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Neutron deleted interface c13d631c-e4c8-488f-9016-c064a98cdad7; detaching it from the instance and deleting it from the info cache
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.network.neutron [req-ad33c684-ec9a-4a36-a5d6-bf4d87d6d02c req-613d32f8-7474-4fcd-8a7b-08249cd4163e service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.manager [req-ad33c684-ec9a-4a36-a5d6-bf4d87d6d02c req-613d32f8-7474-4fcd-8a7b-08249cd4163e service nova] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Detach interface failed, port_id=c13d631c-e4c8-488f-9016-c064a98cdad7, reason: Instance bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:33 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Deleted allocations for instance bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3
Aug 26 15:22:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-86efec94-a99e-483c-acef-0d6eaca86206 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.118s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:36 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:22:37 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:22:38 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:22:38 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:22:38 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8850MB free_disk=25.100921630859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4671dc51-c939-47a0-88d3-f20a7fe61133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:22:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:22:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:47 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693063352.5652018, bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:22:47 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] VM Stopped (Lifecycle Event)
Aug 26 15:22:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-9a0929f5-7365-4304-859a-894b69dc0478 None None] [instance: bbcc4569-8f9d-4240-9d6a-bdc4c94cf8a3] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:22:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:22:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:22:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:22:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:22:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:22:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:22:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:23:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:23:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:23:23 user nova-compute[73052]: INFO nova.compute.manager [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Detaching volume 215b39ea-f382-4e9f-9f06-7957a0e5f23b
Aug 26 15:23:23 user nova-compute[73052]: INFO nova.virt.block_device [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Attempting to driver detach volume 215b39ea-f382-4e9f-9f06-7957a0e5f23b from mountpoint /dev/vdb
Aug 26 15:23:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Attempting to detach device vdb from instance 4671dc51-c939-47a0-88d3-f20a7fe61133 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:23:23 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:23:23 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:23:23 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:23:23 user nova-compute[73052]:   <serial>215b39ea-f382-4e9f-9f06-7957a0e5f23b</serial>
Aug 26 15:23:23 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:23:23 user nova-compute[73052]: </disk>
Aug 26 15:23:23 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:23:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully detached device vdb from instance 4671dc51-c939-47a0-88d3-f20a7fe61133 from the persistent domain config.
Aug 26 15:23:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4671dc51-c939-47a0-88d3-f20a7fe61133 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:23:23 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:23:23 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:23:23 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:23:23 user nova-compute[73052]:   <serial>215b39ea-f382-4e9f-9f06-7957a0e5f23b</serial>
Aug 26 15:23:23 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:23:23 user nova-compute[73052]: </disk>
Aug 26 15:23:23 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693063403.8021858, 4671dc51-c939-47a0-88d3-f20a7fe61133 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:23:23 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully detached device vdb from instance 4671dc51-c939-47a0-88d3-f20a7fe61133 from the live domain config.
Aug 26 15:23:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oipXaHVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:23:23 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b1620-6e57-4be1-8a5e-b52be6a59bf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca214274-aea6-4c22-8442-ecde342f2be1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b (non-flash)
Aug 26 15:23:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b (non-flash)
Aug 26 15:23:23 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c63edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cb3794-d1ab-4a35-bbef-4bdaa9d14a66]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e755581-b39b-420a-b5c4-a594ed2313bc]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2c205e-9cfa-42e8-934c-7d580373f72e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[de34f96d-1071-4a35-8ea7-3439ddf998e5]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[665bbd4d-e5f8-4395-958a-4040479bff08]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:23:23 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d32299-ba63-448c-a3b0-50e0794c283f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b, portal: 172.16.0.220,3260]
Aug 26 15:23:24 user nova-compute[73052]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b, portal: 172.16.0.220,3260] successful.
Aug 26 15:23:24 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215b39ea-f382-4e9f-9f06-7957a0e5f23b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3162506-bb89-467d-b535-b45b9137a0b3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.241s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== disconnect_volume: return (242ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG nova.objects.instance [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:23:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4dc6941d-bfe6-4684-a3cb-fb95c408011b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.541s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:23:27 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:23:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [{"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:23:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-4671dc51-c939-47a0-88d3-f20a7fe61133" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:23:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:23:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:23:31 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:23:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:38 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:38 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:38 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:23:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:23:38 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:23:38 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:23:38 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:23:39 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:23:39 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:23:39 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=25.10021209716797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance 4671dc51-c939-47a0-88d3-f20a7fe61133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:23:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:23:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:23:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:23:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:23:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:23:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:23:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:24:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:24:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:24:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:24:13 user nova-compute[73052]: INFO nova.compute.manager [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Terminating instance
Aug 26 15:24:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-e86625df-a14a-4cde-b6db-48d1367312a6 req-3b54fbd4-933e-4079-9d44-c3f79539b4c1 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received event network-vif-unplugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e86625df-a14a-4cde-b6db-48d1367312a6 req-3b54fbd4-933e-4079-9d44-c3f79539b4c1 service nova] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e86625df-a14a-4cde-b6db-48d1367312a6 req-3b54fbd4-933e-4079-9d44-c3f79539b4c1 service nova] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e86625df-a14a-4cde-b6db-48d1367312a6 req-3b54fbd4-933e-4079-9d44-c3f79539b4c1 service nova] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-e86625df-a14a-4cde-b6db-48d1367312a6 req-3b54fbd4-933e-4079-9d44-c3f79539b4c1 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] No waiting events found dispatching network-vif-unplugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-e86625df-a14a-4cde-b6db-48d1367312a6 req-3b54fbd4-933e-4079-9d44-c3f79539b4c1 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received event network-vif-unplugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:24:14 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Instance destroyed successfully.
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.objects.instance [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'resources' on Instance uuid 4671dc51-c939-47a0-88d3-f20a7fe61133 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-381940687',display_name='tempest-AttachVolumeNegativeTest-server-381940687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-381940687',id=48,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlPErZSE4kpPFeXD3Z494JPQLIfGAXh/L+RdU9ykFAE+6zJL6vgbC+5PTsy8V8U4fHHgYk8tP5+DKch+i8i3wlkUjdqtQBMftjVTxa4p677zae3+lIXPS/BAiXecklbbg==',key_name='tempest-keypair-578419611',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-vcqxnbmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:18:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=4671dc51-c939-47a0-88d3-f20a7fe61133,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "address": "fa:16:3e:eb:47:ad", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c2bda4-64", "ovs_interfaceid": "23c2bda4-64bd-49c4-8b66-69bbd0ccfb41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:47:ad,bridge_name='br-int',has_traffic_filtering=True,id=23c2bda4-64bd-49c4-8b66-69bbd0ccfb41,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c2bda4-64') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG os_vif [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:47:ad,bridge_name='br-int',has_traffic_filtering=True,id=23c2bda4-64bd-49c4-8b66-69bbd0ccfb41,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c2bda4-64') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23c2bda4-64, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:14 user nova-compute[73052]: INFO os_vif [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:47:ad,bridge_name='br-int',has_traffic_filtering=True,id=23c2bda4-64bd-49c4-8b66-69bbd0ccfb41,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c2bda4-64')
Aug 26 15:24:14 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Deleting instance files /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133_del
Aug 26 15:24:14 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Deletion of /opt/stack/data/nova/instances/4671dc51-c939-47a0-88d3-f20a7fe61133_del complete
Aug 26 15:24:14 user nova-compute[73052]: INFO nova.compute.manager [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 15:24:14 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:24:14 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:24:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:15 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:24:15 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Took 0.82 seconds to deallocate network for instance.
Aug 26 15:24:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-741fd717-67f9-493c-87da-f947c47c2c72 req-5adf6789-fe20-4bd4-8cfc-5efc55b55968 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received event network-vif-deleted-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:24:15 user nova-compute[73052]: INFO nova.compute.manager [req-741fd717-67f9-493c-87da-f947c47c2c72 req-5adf6789-fe20-4bd4-8cfc-5efc55b55968 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Neutron deleted interface 23c2bda4-64bd-49c4-8b66-69bbd0ccfb41; detaching it from the instance and deleting it from the info cache
Aug 26 15:24:15 user nova-compute[73052]: DEBUG nova.network.neutron [req-741fd717-67f9-493c-87da-f947c47c2c72 req-5adf6789-fe20-4bd4-8cfc-5efc55b55968 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:24:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-741fd717-67f9-493c-87da-f947c47c2c72 req-5adf6789-fe20-4bd4-8cfc-5efc55b55968 service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Detach interface failed, port_id=23c2bda4-64bd-49c4-8b66-69bbd0ccfb41, reason: Instance 4671dc51-c939-47a0-88d3-f20a7fe61133 could not be found. {{(pid=73052) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 15:24:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:24:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:24:15 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:24:15 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:24:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:24:15 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Deleted allocations for instance 4671dc51-c939-47a0-88d3-f20a7fe61133
Aug 26 15:24:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4235418a-e012-4b1e-babf-b7959814f612 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:24:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-03d378d1-503f-4d28-b7a6-6992f22acf4f req-5a09ec1b-6fcd-4075-b977-1a3bd09d66aa service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received event network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:24:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-03d378d1-503f-4d28-b7a6-6992f22acf4f req-5a09ec1b-6fcd-4075-b977-1a3bd09d66aa service nova] Acquiring lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:24:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-03d378d1-503f-4d28-b7a6-6992f22acf4f req-5a09ec1b-6fcd-4075-b977-1a3bd09d66aa service nova] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:24:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-03d378d1-503f-4d28-b7a6-6992f22acf4f req-5a09ec1b-6fcd-4075-b977-1a3bd09d66aa service nova] Lock "4671dc51-c939-47a0-88d3-f20a7fe61133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:24:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-03d378d1-503f-4d28-b7a6-6992f22acf4f req-5a09ec1b-6fcd-4075-b977-1a3bd09d66aa service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] No waiting events found dispatching network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:24:16 user nova-compute[73052]: WARNING nova.compute.manager [req-03d378d1-503f-4d28-b7a6-6992f22acf4f req-5a09ec1b-6fcd-4075-b977-1a3bd09d66aa service nova] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Received unexpected event network-vif-plugged-23c2bda4-64bd-49c4-8b66-69bbd0ccfb41 for instance with vm_state deleted and task_state None.
Aug 26 15:24:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:24:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:24:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:24:29 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693063454.523204, 4671dc51-c939-47a0-88d3-f20a7fe61133 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:24:29 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] VM Stopped (Lifecycle Event)
Aug 26 15:24:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-0fb6783d-b4d3-4e4e-857e-0af4b3a3f73b None None] [instance: 4671dc51-c939-47a0-88d3-f20a7fe61133] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:24:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:29 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:24:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:38 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:24:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:24:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:24:39 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:24:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:24:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:24:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.127456665039062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:24:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:24:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:24:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:24:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:24:40 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:24:40 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:24:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:24:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:24:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:24:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:24:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:24:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:25:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:07 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:07 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:25:08 user nova-compute[73052]: INFO nova.compute.claims [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Claim successful on node user
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:25:08 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.policy [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c10396c807443083b436339dbb932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdfc74b3d74cc09c18b16504341125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:25:08 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Creating image(s)
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "/opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "/opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "/opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.182s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.178s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk 1073741824" returned: 0 in 0.052s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:08 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.180s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Cannot resize image /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Ensure instance console log exists: /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Successfully created port: e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:25:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Successfully updated port: e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquired lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-2352a22d-0aad-4dcd-82fd-e56c666bf022 req-4ecf952e-4cd8-467a-b2a4-000c640b59cf service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-changed-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.compute.manager [req-2352a22d-0aad-4dcd-82fd-e56c666bf022 req-4ecf952e-4cd8-467a-b2a4-000c640b59cf service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Refreshing instance network info cache due to event network-changed-e0886656-8942-4a57-aec9-5b9cbe85262a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2352a22d-0aad-4dcd-82fd-e56c666bf022 req-4ecf952e-4cd8-467a-b2a4-000c640b59cf service nova] Acquiring lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updating instance_info_cache with network_info: [{"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Releasing lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Instance network_info: |[{"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2352a22d-0aad-4dcd-82fd-e56c666bf022 req-4ecf952e-4cd8-467a-b2a4-000c640b59cf service nova] Acquired lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.neutron [req-2352a22d-0aad-4dcd-82fd-e56c666bf022 req-4ecf952e-4cd8-467a-b2a4-000c640b59cf service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Refreshing network info cache for port e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Start _get_guest_xml network_info=[{"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:25:10 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:25:10 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-863889161',display_name='tempest-AttachVolumeNegativeTest-server-863889161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-863889161',id=50,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY1K/Vzl2lR/YPO43fdBtyoYw54hmBhFi5iuOdAuYN2JxyKUWyA6R7g5ZLEYUzVLpHDtPrZLOycewOLCDr2M2KoqZ14K3/vLyLzbvsJRSxHJ2IXBmd3E+4S1CaimL1xCA==',key_name='tempest-keypair-2043463269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-ihev70c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=b34d3aa4-f71b-4814-aa2c-d400ce9244b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:32:2f,bridge_name='br-int',has_traffic_filtering=True,id=e0886656-8942-4a57-aec9-5b9cbe85262a,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0886656-89') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.objects.instance [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'pci_devices' on Instance uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:25:10 user nova-compute[73052]:   <uuid>b34d3aa4-f71b-4814-aa2c-d400ce9244b4</uuid>
Aug 26 15:25:10 user nova-compute[73052]:   <name>instance-00000032</name>
Aug 26 15:25:10 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:25:10 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:25:10 user nova-compute[73052]:   <metadata>
Aug 26 15:25:10 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:25:10 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:25:10 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeNegativeTest-server-863889161</nova:name>
Aug 26 15:25:10 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:25:10</nova:creationTime>
Aug 26 15:25:10 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:25:10 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:25:10 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:25:10 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:25:10 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:25:10 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:25:10 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:25:10 user nova-compute[73052]:       <nova:owner>
Aug 26 15:25:10 user nova-compute[73052]:         <nova:user uuid="36c10396c807443083b436339dbb932a">tempest-AttachVolumeNegativeTest-1607008473-project-member</nova:user>
Aug 26 15:25:10 user nova-compute[73052]:         <nova:project uuid="cfbdfc74b3d74cc09c18b16504341125">tempest-AttachVolumeNegativeTest-1607008473</nova:project>
Aug 26 15:25:10 user nova-compute[73052]:       </nova:owner>
Aug 26 15:25:10 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:25:10 user nova-compute[73052]:       <nova:ports>
Aug 26 15:25:10 user nova-compute[73052]:         <nova:port uuid="e0886656-8942-4a57-aec9-5b9cbe85262a">
Aug 26 15:25:10 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 15:25:10 user nova-compute[73052]:         </nova:port>
Aug 26 15:25:10 user nova-compute[73052]:       </nova:ports>
Aug 26 15:25:10 user nova-compute[73052]:     </nova:instance>
Aug 26 15:25:10 user nova-compute[73052]:   </metadata>
Aug 26 15:25:10 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:25:10 user nova-compute[73052]:     <system>
Aug 26 15:25:10 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:25:10 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:25:10 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:25:10 user nova-compute[73052]:       <entry name="serial">b34d3aa4-f71b-4814-aa2c-d400ce9244b4</entry>
Aug 26 15:25:10 user nova-compute[73052]:       <entry name="uuid">b34d3aa4-f71b-4814-aa2c-d400ce9244b4</entry>
Aug 26 15:25:10 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:25:10 user nova-compute[73052]:     </system>
Aug 26 15:25:10 user nova-compute[73052]:   </sysinfo>
Aug 26 15:25:10 user nova-compute[73052]:   <os>
Aug 26 15:25:10 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:25:10 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:25:10 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:25:10 user nova-compute[73052]:   </os>
Aug 26 15:25:10 user nova-compute[73052]:   <features>
Aug 26 15:25:10 user nova-compute[73052]:     <acpi/>
Aug 26 15:25:10 user nova-compute[73052]:     <apic/>
Aug 26 15:25:10 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:25:10 user nova-compute[73052]:   </features>
Aug 26 15:25:10 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:25:10 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:25:10 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:25:10 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:25:10 user nova-compute[73052]:   </clock>
Aug 26 15:25:10 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:25:10 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:25:10 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:25:10 user nova-compute[73052]:   </cpu>
Aug 26 15:25:10 user nova-compute[73052]:   <devices>
Aug 26 15:25:10 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:25:10 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:25:10 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk"/>
Aug 26 15:25:10 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:25:10 user nova-compute[73052]:     </disk>
Aug 26 15:25:10 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:25:10 user nova-compute[73052]:       <mac address="fa:16:3e:1c:32:2f"/>
Aug 26 15:25:10 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:25:10 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:25:10 user nova-compute[73052]:       <target dev="tape0886656-89"/>
Aug 26 15:25:10 user nova-compute[73052]:     </interface>
Aug 26 15:25:10 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:25:10 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/console.log" append="off"/>
Aug 26 15:25:10 user nova-compute[73052]:     </serial>
Aug 26 15:25:10 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:25:10 user nova-compute[73052]:     <video>
Aug 26 15:25:10 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:25:10 user nova-compute[73052]:     </video>
Aug 26 15:25:10 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:25:10 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:25:10 user nova-compute[73052]:     </rng>
Aug 26 15:25:10 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:25:10 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:25:10 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:25:10 user nova-compute[73052]:     </memballoon>
Aug 26 15:25:10 user nova-compute[73052]:   </devices>
Aug 26 15:25:10 user nova-compute[73052]: </domain>
Aug 26 15:25:10 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-863889161',display_name='tempest-AttachVolumeNegativeTest-server-863889161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-863889161',id=50,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY1K/Vzl2lR/YPO43fdBtyoYw54hmBhFi5iuOdAuYN2JxyKUWyA6R7g5ZLEYUzVLpHDtPrZLOycewOLCDr2M2KoqZ14K3/vLyLzbvsJRSxHJ2IXBmd3E+4S1CaimL1xCA==',key_name='tempest-keypair-2043463269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-ihev70c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=b34d3aa4-f71b-4814-aa2c-d400ce9244b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:32:2f,bridge_name='br-int',has_traffic_filtering=True,id=e0886656-8942-4a57-aec9-5b9cbe85262a,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0886656-89') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG os_vif [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:32:2f,bridge_name='br-int',has_traffic_filtering=True,id=e0886656-8942-4a57-aec9-5b9cbe85262a,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0886656-89') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0886656-89, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0886656-89, col_values=(('external_ids', {'iface-id': 'e0886656-8942-4a57-aec9-5b9cbe85262a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:32:2f', 'vm-uuid': 'b34d3aa4-f71b-4814-aa2c-d400ce9244b4'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:10 user nova-compute[73052]: INFO os_vif [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:32:2f,bridge_name='br-int',has_traffic_filtering=True,id=e0886656-8942-4a57-aec9-5b9cbe85262a,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0886656-89')
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No VIF found with MAC fa:16:3e:1c:32:2f, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.neutron [req-2352a22d-0aad-4dcd-82fd-e56c666bf022 req-4ecf952e-4cd8-467a-b2a4-000c640b59cf service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updated VIF entry in instance network info cache for port e0886656-8942-4a57-aec9-5b9cbe85262a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG nova.network.neutron [req-2352a22d-0aad-4dcd-82fd-e56c666bf022 req-4ecf952e-4cd8-467a-b2a4-000c640b59cf service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updating instance_info_cache with network_info: [{"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:25:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-2352a22d-0aad-4dcd-82fd-e56c666bf022 req-4ecf952e-4cd8-467a-b2a4-000c640b59cf service nova] Releasing lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:25:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-fd29de0f-9162-4edc-b9bd-82712deafcc8 req-2e81f91b-c101-4f4b-b6c5-bed9f3bf3d62 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:25:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fd29de0f-9162-4edc-b9bd-82712deafcc8 req-2e81f91b-c101-4f4b-b6c5-bed9f3bf3d62 service nova] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fd29de0f-9162-4edc-b9bd-82712deafcc8 req-2e81f91b-c101-4f4b-b6c5-bed9f3bf3d62 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fd29de0f-9162-4edc-b9bd-82712deafcc8 req-2e81f91b-c101-4f4b-b6c5-bed9f3bf3d62 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-fd29de0f-9162-4edc-b9bd-82712deafcc8 req-2e81f91b-c101-4f4b-b6c5-bed9f3bf3d62 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] No waiting events found dispatching network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:25:11 user nova-compute[73052]: WARNING nova.compute.manager [req-fd29de0f-9162-4edc-b9bd-82712deafcc8 req-2e81f91b-c101-4f4b-b6c5-bed9f3bf3d62 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received unexpected event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a for instance with vm_state building and task_state spawning.
Aug 26 15:25:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693063513.908907, b34d3aa4-f71b-4814-aa2c-d400ce9244b4 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:25:13 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] VM Resumed (Lifecycle Event)
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:25:13 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Instance spawned successfully.
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:25:13 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693063513.9127593, b34d3aa4-f71b-4814-aa2c-d400ce9244b4 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:25:13 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] VM Started (Lifecycle Event)
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:25:13 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:25:14 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:25:14 user nova-compute[73052]: INFO nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Took 5.61 seconds to spawn the instance on the hypervisor.
Aug 26 15:25:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:25:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-867a7649-a2ad-4e61-aaa4-cf47536d7a98 req-6c6d8bb2-b5e8-473d-a747-646133f4a913 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:25:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-867a7649-a2ad-4e61-aaa4-cf47536d7a98 req-6c6d8bb2-b5e8-473d-a747-646133f4a913 service nova] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-867a7649-a2ad-4e61-aaa4-cf47536d7a98 req-6c6d8bb2-b5e8-473d-a747-646133f4a913 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-867a7649-a2ad-4e61-aaa4-cf47536d7a98 req-6c6d8bb2-b5e8-473d-a747-646133f4a913 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:14 user nova-compute[73052]: DEBUG nova.compute.manager [req-867a7649-a2ad-4e61-aaa4-cf47536d7a98 req-6c6d8bb2-b5e8-473d-a747-646133f4a913 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] No waiting events found dispatching network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:25:14 user nova-compute[73052]: WARNING nova.compute.manager [req-867a7649-a2ad-4e61-aaa4-cf47536d7a98 req-6c6d8bb2-b5e8-473d-a747-646133f4a913 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received unexpected event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a for instance with vm_state building and task_state spawning.
Aug 26 15:25:14 user nova-compute[73052]: INFO nova.compute.manager [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Took 6.11 seconds to build instance.
Aug 26 15:25:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-fa1b2cce-a74e-4d4f-ae4a-2b1930a04385 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.193s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:25:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:25:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:25:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:25:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:25:27 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:25:28 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updating instance_info_cache with network_info: [{"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:25:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:25:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:25:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:25:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:25:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:25:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:25:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:31 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:31 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:25:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:39 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:25:39 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:25:40 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:25:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.097900390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:25:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:25:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:25:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:26:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:26:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:26:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:26:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:26:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:26:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:28 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:26:28 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:26:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:26:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:26:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:26:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:26:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updating instance_info_cache with network_info: [{"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:26:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:26:29 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:26:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:26:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:26:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:26:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:26:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:26:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:26:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:26:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:26:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:26:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:26:41 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:26:41 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:26:42 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:26:42 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:26:42 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.09716796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:26:42 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:26:43 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:26:43 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:26:43 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:26:43 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:26:43 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:26:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:26:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:26:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:26:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:26:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-c5460cbc-5c96-486b-a8a4-91fd86b9b707 req-7c97d135-654c-4026-9bd6-97edfb0a7d58 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-changed-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:26:59 user nova-compute[73052]: DEBUG nova.compute.manager [req-c5460cbc-5c96-486b-a8a4-91fd86b9b707 req-7c97d135-654c-4026-9bd6-97edfb0a7d58 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Refreshing instance network info cache due to event network-changed-e0886656-8942-4a57-aec9-5b9cbe85262a. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:26:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c5460cbc-5c96-486b-a8a4-91fd86b9b707 req-7c97d135-654c-4026-9bd6-97edfb0a7d58 service nova] Acquiring lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:26:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c5460cbc-5c96-486b-a8a4-91fd86b9b707 req-7c97d135-654c-4026-9bd6-97edfb0a7d58 service nova] Acquired lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:26:59 user nova-compute[73052]: DEBUG nova.network.neutron [req-c5460cbc-5c96-486b-a8a4-91fd86b9b707 req-7c97d135-654c-4026-9bd6-97edfb0a7d58 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Refreshing network info cache for port e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:26:59 user nova-compute[73052]: DEBUG nova.network.neutron [req-c5460cbc-5c96-486b-a8a4-91fd86b9b707 req-7c97d135-654c-4026-9bd6-97edfb0a7d58 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updated VIF entry in instance network info cache for port e0886656-8942-4a57-aec9-5b9cbe85262a. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:26:59 user nova-compute[73052]: DEBUG nova.network.neutron [req-c5460cbc-5c96-486b-a8a4-91fd86b9b707 req-7c97d135-654c-4026-9bd6-97edfb0a7d58 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updating instance_info_cache with network_info: [{"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:26:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c5460cbc-5c96-486b-a8a4-91fd86b9b707 req-7c97d135-654c-4026-9bd6-97edfb0a7d58 service nova] Releasing lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:27:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:27:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:00 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:27:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:27:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG nova.objects.instance [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:27:05 user nova-compute[73052]: INFO nova.compute.manager [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Attaching volume ef00ebae-f0d2-4e8f-892c-539de87bc314 to /dev/vdb
Aug 26 15:27:05 user nova-compute[73052]: DEBUG os_brick.utils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c263f7-0064-40ac-bf21-71245f4867ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7621e6-bb9a-4d5f-ab3f-650903ab55ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c52f93a-daab-4d05-ad5e-24082cebe089]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbfb1d8-450a-4bc5-bcbf-b4ff83e89b06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:27:05 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:27:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20ffdbf-81e8-4326-b1d0-ce344dec9497]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG os_brick.utils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updating existing volume attachment record: acfc0228-cffc-4507-a734-4360be0d6f45 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:27:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MglBGsOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:27:22 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:27:22 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:27:22 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[30afb062-c00a-4aeb-bbe3-bd56c054d234]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:27:22 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8439e80e-29dc-4950-b16d-4dd3231154e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314] added
Aug 26 15:27:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c03e1f-df57-4266-a30e-743098c03087]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1826098d-5235-46e7-844c-27d53536e545]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MglBGsOb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MglBGsOb" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04357b0-6a8a-42f5-af0d-b604c254af18]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MglBGsOb'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ab8ee8-6ae6-4d98-9b69-78aec35ac372]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5505cbf-3dc2-4a4d-afd7-239a898a05d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:27:22 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:27:22 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:27:22 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:27:22 user nova-compute[73052]: 
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c3c47e-36c0-4415-b296-eeffa3ed560b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314, portal: 172.16.0.220,3260]
Aug 26 15:27:22 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314, portal: 172.16.0.220,3260] successful.
Aug 26 15:27:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[632c860f-a6ed-425a-88e2-297e336d7500]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e7457-251e-4121-b093-09ebef780d0e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 (non-flash)
Aug 26 15:27:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 (non-flash)
Aug 26 15:27:22 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dedc2a-cc66-4547-afdd-c379353bc35e]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:27:22 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MglBGsOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23532336333383434', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532336333383434', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG nova.objects.instance [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:27:23 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:27:23 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:27:23 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:27:23 user nova-compute[73052]:   <serial>ef00ebae-f0d2-4e8f-892c-539de87bc314</serial>
Aug 26 15:27:23 user nova-compute[73052]: </disk>
Aug 26 15:27:23 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No VIF found with MAC fa:16:3e:1c:32:2f, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:27:23 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-534d6fd2-7294-4141-a661-0e194aa9f048 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.699s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:27:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:27:24 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:27:24 user nova-compute[73052]: INFO nova.compute.manager [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Detaching volume ef00ebae-f0d2-4e8f-892c-539de87bc314
Aug 26 15:27:24 user nova-compute[73052]: INFO nova.virt.block_device [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Attempting to driver detach volume ef00ebae-f0d2-4e8f-892c-539de87bc314 from mountpoint /dev/vdb
Aug 26 15:27:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Attempting to detach device vdb from instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:27:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:27:24 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:27:24 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:27:24 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:27:24 user nova-compute[73052]:   <serial>ef00ebae-f0d2-4e8f-892c-539de87bc314</serial>
Aug 26 15:27:24 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:27:24 user nova-compute[73052]: </disk>
Aug 26 15:27:24 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:27:24 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully detached device vdb from instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4 from the persistent domain config.
Aug 26 15:27:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:27:24 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:27:24 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:27:24 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:27:24 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:27:24 user nova-compute[73052]:   <serial>ef00ebae-f0d2-4e8f-892c-539de87bc314</serial>
Aug 26 15:27:24 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:27:24 user nova-compute[73052]: </disk>
Aug 26 15:27:24 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693063645.2959588, b34d3aa4-f71b-4814-aa2c-d400ce9244b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:27:25 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully detached device vdb from instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4 from the live domain config.
Aug 26 15:27:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MglBGsOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:27:25 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[75492332-b4a0-4666-a770-af6afdd4416e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef4d3c8-d2c5-4c20-90c9-3328425e8864]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 (non-flash)
Aug 26 15:27:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 (non-flash)
Aug 26 15:27:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01e7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6abf79-bda6-4eab-9b74-b559099e6d17]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[566f7e80-3ce6-499c-ab97-a1b770c3a148]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[915b3c50-e156-4473-b9da-2617e7acf416]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc61b3a-f77f-4318-b990-ee5c3fac4abc]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a74281-da13-4e28-bd88-5320024ed2ad]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75be6d4-e626-43c8-9660-0e0e641494e6]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314, portal: 172.16.0.220,3260]
Aug 26 15:27:25 user nova-compute[73052]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314, portal: 172.16.0.220,3260] successful.
Aug 26 15:27:25 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef00ebae-f0d2-4e8f-892c-539de87bc314 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b438523f-e47d-4119-aeab-047e417bb2ca]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== disconnect_volume: return (261ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:26 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:27:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c39c677f-61db-419d-b484-65996e9e3b0b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:27:30 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:27:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:31 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updating instance_info_cache with network_info: [{"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:27:31 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-b34d3aa4-f71b-4814-aa2c-d400ce9244b4" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:27:31 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:27:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:33 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:27:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:27:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:27:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:27:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:27:43 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:27:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:27:44 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:27:44 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:27:44 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=25.09601593017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:27:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:27:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:27:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:27:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:27:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:27:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:27:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:27:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:27:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:27:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:27:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:27:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:15 user nova-compute[73052]: INFO nova.compute.manager [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Terminating instance
Aug 26 15:28:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-ac789d4d-a3aa-4263-955b-2b95de6532c1 req-bcac227a-eb73-47d4-9eba-6457078401ef service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-unplugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ac789d4d-a3aa-4263-955b-2b95de6532c1 req-bcac227a-eb73-47d4-9eba-6457078401ef service nova] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ac789d4d-a3aa-4263-955b-2b95de6532c1 req-bcac227a-eb73-47d4-9eba-6457078401ef service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-ac789d4d-a3aa-4263-955b-2b95de6532c1 req-bcac227a-eb73-47d4-9eba-6457078401ef service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-ac789d4d-a3aa-4263-955b-2b95de6532c1 req-bcac227a-eb73-47d4-9eba-6457078401ef service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] No waiting events found dispatching network-vif-unplugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-ac789d4d-a3aa-4263-955b-2b95de6532c1 req-bcac227a-eb73-47d4-9eba-6457078401ef service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-unplugged-e0886656-8942-4a57-aec9-5b9cbe85262a for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Instance destroyed successfully.
Aug 26 15:28:15 user nova-compute[73052]: DEBUG nova.objects.instance [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'resources' on Instance uuid b34d3aa4-f71b-4814-aa2c-d400ce9244b4 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-863889161',display_name='tempest-AttachVolumeNegativeTest-server-863889161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-863889161',id=50,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY1K/Vzl2lR/YPO43fdBtyoYw54hmBhFi5iuOdAuYN2JxyKUWyA6R7g5ZLEYUzVLpHDtPrZLOycewOLCDr2M2KoqZ14K3/vLyLzbvsJRSxHJ2IXBmd3E+4S1CaimL1xCA==',key_name='tempest-keypair-2043463269',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:25:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-ihev70c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=b34d3aa4-f71b-4814-aa2c-d400ce9244b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "e0886656-8942-4a57-aec9-5b9cbe85262a", "address": "fa:16:3e:1c:32:2f", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0886656-89", "ovs_interfaceid": "e0886656-8942-4a57-aec9-5b9cbe85262a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:32:2f,bridge_name='br-int',has_traffic_filtering=True,id=e0886656-8942-4a57-aec9-5b9cbe85262a,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0886656-89') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG os_vif [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:32:2f,bridge_name='br-int',has_traffic_filtering=True,id=e0886656-8942-4a57-aec9-5b9cbe85262a,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0886656-89') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0886656-89, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:15 user nova-compute[73052]: INFO os_vif [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:32:2f,bridge_name='br-int',has_traffic_filtering=True,id=e0886656-8942-4a57-aec9-5b9cbe85262a,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0886656-89')
Aug 26 15:28:15 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Deleting instance files /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4_del
Aug 26 15:28:15 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Deletion of /opt/stack/data/nova/instances/b34d3aa4-f71b-4814-aa2c-d400ce9244b4_del complete
Aug 26 15:28:16 user nova-compute[73052]: INFO nova.compute.manager [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 15:28:16 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:28:16 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:28:16 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:28:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:16 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:28:16 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Took 0.94 seconds to deallocate network for instance.
Aug 26 15:28:16 user nova-compute[73052]: DEBUG nova.compute.manager [req-26efcbe4-1085-4bfe-9947-76269ebf5b09 req-09f83ff5-4c4f-48fa-b025-3e000a434341 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-deleted-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:17 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Deleted allocations for instance b34d3aa4-f71b-4814-aa2c-d400ce9244b4
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-08ea7458-07c1-4c24-a107-1478b2901724 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] No waiting events found dispatching network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:28:17 user nova-compute[73052]: WARNING nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received unexpected event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a for instance with vm_state deleted and task_state None.
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] No waiting events found dispatching network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:28:17 user nova-compute[73052]: WARNING nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received unexpected event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a for instance with vm_state deleted and task_state None.
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] No waiting events found dispatching network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:28:17 user nova-compute[73052]: WARNING nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received unexpected event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a for instance with vm_state deleted and task_state None.
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-unplugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] No waiting events found dispatching network-vif-unplugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:28:17 user nova-compute[73052]: WARNING nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received unexpected event network-vif-unplugged-e0886656-8942-4a57-aec9-5b9cbe85262a for instance with vm_state deleted and task_state None.
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Acquiring lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] Lock "b34d3aa4-f71b-4814-aa2c-d400ce9244b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:17 user nova-compute[73052]: DEBUG nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] No waiting events found dispatching network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:28:17 user nova-compute[73052]: WARNING nova.compute.manager [req-7f7ca3c1-bf9d-4467-894d-89e3af0d9c5d req-67b1cfeb-3e5c-416d-ab85-d228d47061d6 service nova] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Received unexpected event network-vif-plugged-e0886656-8942-4a57-aec9-5b9cbe85262a for instance with vm_state deleted and task_state None.
Aug 26 15:28:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:30 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693063695.9181495, b34d3aa4-f71b-4814-aa2c-d400ce9244b4 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:28:30 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] VM Stopped (Lifecycle Event)
Aug 26 15:28:30 user nova-compute[73052]: DEBUG nova.compute.manager [None req-45a798c5-f8f3-41f7-a744-cdec78c23bef None None] [instance: b34d3aa4-f71b-4814-aa2c-d400ce9244b4] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:28:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:28:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:28:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:28:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:28:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:42 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:44 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:44 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:28:45 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:28:45 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:28:45 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.123149871826172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:28:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:28:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:28:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:28:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:28:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:29:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:29:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:29:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:29:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:29:09 user nova-compute[73052]: INFO nova.compute.claims [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Claim successful on node user
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:29:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.policy [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c10396c807443083b436339dbb932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdfc74b3d74cc09c18b16504341125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:29:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:29:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Creating image(s)
Aug 26 15:29:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "/opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "/opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "/opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk 1073741824" returned: 0 in 0.050s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Successfully created port: e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Cannot resize image /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Ensure instance console log exists: /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Successfully updated port: e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquired lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2c45080-090b-4190-81fe-e5121635a1ec req-5c9b322f-b6ac-4115-a720-0eb0296c90cb service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received event network-changed-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-f2c45080-090b-4190-81fe-e5121635a1ec req-5c9b322f-b6ac-4115-a720-0eb0296c90cb service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Refreshing instance network info cache due to event network-changed-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2c45080-090b-4190-81fe-e5121635a1ec req-5c9b322f-b6ac-4115-a720-0eb0296c90cb service nova] Acquiring lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:29:11 user nova-compute[73052]: DEBUG nova.network.neutron [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updating instance_info_cache with network_info: [{"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Releasing lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Instance network_info: |[{"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2c45080-090b-4190-81fe-e5121635a1ec req-5c9b322f-b6ac-4115-a720-0eb0296c90cb service nova] Acquired lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.network.neutron [req-f2c45080-090b-4190-81fe-e5121635a1ec req-5c9b322f-b6ac-4115-a720-0eb0296c90cb service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Refreshing network info cache for port e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Start _get_guest_xml network_info=[{"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:29:12 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:29:12 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1462081888',display_name='tempest-AttachVolumeNegativeTest-server-1462081888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1462081888',id=51,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++JxxsXt706+uPBB9JCaehsmYBWFOzaXzr4+Qlv7Fp5ooDU9/HMjDPUhtJ1q/co562DgnlxSgBd+GavLEhwRJU8rF4/i0ne2zO8p5CF0B2ddxFTj2yItRpGHBax+3VLg==',key_name='tempest-keypair-682145588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-ikvrp5eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=e026b5a7-f19d-4eca-8e74-a5aa8089ed35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f3:e9,bridge_name='br-int',has_traffic_filtering=True,id=e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38ac794-17') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'pci_devices' on Instance uuid e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:29:12 user nova-compute[73052]:   <uuid>e026b5a7-f19d-4eca-8e74-a5aa8089ed35</uuid>
Aug 26 15:29:12 user nova-compute[73052]:   <name>instance-00000033</name>
Aug 26 15:29:12 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:29:12 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:29:12 user nova-compute[73052]:   <metadata>
Aug 26 15:29:12 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:29:12 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:29:12 user nova-compute[73052]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1462081888</nova:name>
Aug 26 15:29:12 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:29:12</nova:creationTime>
Aug 26 15:29:12 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:29:12 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:29:12 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:29:12 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:29:12 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:29:12 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:29:12 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:29:12 user nova-compute[73052]:       <nova:owner>
Aug 26 15:29:12 user nova-compute[73052]:         <nova:user uuid="36c10396c807443083b436339dbb932a">tempest-AttachVolumeNegativeTest-1607008473-project-member</nova:user>
Aug 26 15:29:12 user nova-compute[73052]:         <nova:project uuid="cfbdfc74b3d74cc09c18b16504341125">tempest-AttachVolumeNegativeTest-1607008473</nova:project>
Aug 26 15:29:12 user nova-compute[73052]:       </nova:owner>
Aug 26 15:29:12 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:29:12 user nova-compute[73052]:       <nova:ports>
Aug 26 15:29:12 user nova-compute[73052]:         <nova:port uuid="e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7">
Aug 26 15:29:12 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 15:29:12 user nova-compute[73052]:         </nova:port>
Aug 26 15:29:12 user nova-compute[73052]:       </nova:ports>
Aug 26 15:29:12 user nova-compute[73052]:     </nova:instance>
Aug 26 15:29:12 user nova-compute[73052]:   </metadata>
Aug 26 15:29:12 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:29:12 user nova-compute[73052]:     <system>
Aug 26 15:29:12 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:29:12 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:29:12 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:29:12 user nova-compute[73052]:       <entry name="serial">e026b5a7-f19d-4eca-8e74-a5aa8089ed35</entry>
Aug 26 15:29:12 user nova-compute[73052]:       <entry name="uuid">e026b5a7-f19d-4eca-8e74-a5aa8089ed35</entry>
Aug 26 15:29:12 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:29:12 user nova-compute[73052]:     </system>
Aug 26 15:29:12 user nova-compute[73052]:   </sysinfo>
Aug 26 15:29:12 user nova-compute[73052]:   <os>
Aug 26 15:29:12 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:29:12 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:29:12 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:29:12 user nova-compute[73052]:   </os>
Aug 26 15:29:12 user nova-compute[73052]:   <features>
Aug 26 15:29:12 user nova-compute[73052]:     <acpi/>
Aug 26 15:29:12 user nova-compute[73052]:     <apic/>
Aug 26 15:29:12 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:29:12 user nova-compute[73052]:   </features>
Aug 26 15:29:12 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:29:12 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:29:12 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:29:12 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:29:12 user nova-compute[73052]:   </clock>
Aug 26 15:29:12 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:29:12 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:29:12 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:29:12 user nova-compute[73052]:   </cpu>
Aug 26 15:29:12 user nova-compute[73052]:   <devices>
Aug 26 15:29:12 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:29:12 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:29:12 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk"/>
Aug 26 15:29:12 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:29:12 user nova-compute[73052]:     </disk>
Aug 26 15:29:12 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:29:12 user nova-compute[73052]:       <mac address="fa:16:3e:87:f3:e9"/>
Aug 26 15:29:12 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:29:12 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:29:12 user nova-compute[73052]:       <target dev="tape38ac794-17"/>
Aug 26 15:29:12 user nova-compute[73052]:     </interface>
Aug 26 15:29:12 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:29:12 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/console.log" append="off"/>
Aug 26 15:29:12 user nova-compute[73052]:     </serial>
Aug 26 15:29:12 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:29:12 user nova-compute[73052]:     <video>
Aug 26 15:29:12 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:29:12 user nova-compute[73052]:     </video>
Aug 26 15:29:12 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:29:12 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:29:12 user nova-compute[73052]:     </rng>
Aug 26 15:29:12 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:29:12 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:29:12 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:29:12 user nova-compute[73052]:     </memballoon>
Aug 26 15:29:12 user nova-compute[73052]:   </devices>
Aug 26 15:29:12 user nova-compute[73052]: </domain>
Aug 26 15:29:12 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1462081888',display_name='tempest-AttachVolumeNegativeTest-server-1462081888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1462081888',id=51,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++JxxsXt706+uPBB9JCaehsmYBWFOzaXzr4+Qlv7Fp5ooDU9/HMjDPUhtJ1q/co562DgnlxSgBd+GavLEhwRJU8rF4/i0ne2zO8p5CF0B2ddxFTj2yItRpGHBax+3VLg==',key_name='tempest-keypair-682145588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-ikvrp5eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=e026b5a7-f19d-4eca-8e74-a5aa8089ed35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f3:e9,bridge_name='br-int',has_traffic_filtering=True,id=e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38ac794-17') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG os_vif [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f3:e9,bridge_name='br-int',has_traffic_filtering=True,id=e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38ac794-17') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape38ac794-17, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape38ac794-17, col_values=(('external_ids', {'iface-id': 'e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f3:e9', 'vm-uuid': 'e026b5a7-f19d-4eca-8e74-a5aa8089ed35'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:12 user nova-compute[73052]: INFO os_vif [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f3:e9,bridge_name='br-int',has_traffic_filtering=True,id=e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38ac794-17')
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No VIF found with MAC fa:16:3e:87:f3:e9, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.network.neutron [req-f2c45080-090b-4190-81fe-e5121635a1ec req-5c9b322f-b6ac-4115-a720-0eb0296c90cb service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updated VIF entry in instance network info cache for port e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG nova.network.neutron [req-f2c45080-090b-4190-81fe-e5121635a1ec req-5c9b322f-b6ac-4115-a720-0eb0296c90cb service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updating instance_info_cache with network_info: [{"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:29:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-f2c45080-090b-4190-81fe-e5121635a1ec req-5c9b322f-b6ac-4115-a720-0eb0296c90cb service nova] Releasing lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-4f0dec59-6ed1-41ec-99e2-1c6b4cc34553 req-92126096-3432-4d62-9d87-25c476700e11 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received event network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4f0dec59-6ed1-41ec-99e2-1c6b4cc34553 req-92126096-3432-4d62-9d87-25c476700e11 service nova] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4f0dec59-6ed1-41ec-99e2-1c6b4cc34553 req-92126096-3432-4d62-9d87-25c476700e11 service nova] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4f0dec59-6ed1-41ec-99e2-1c6b4cc34553 req-92126096-3432-4d62-9d87-25c476700e11 service nova] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:13 user nova-compute[73052]: DEBUG nova.compute.manager [req-4f0dec59-6ed1-41ec-99e2-1c6b4cc34553 req-92126096-3432-4d62-9d87-25c476700e11 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] No waiting events found dispatching network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:29:13 user nova-compute[73052]: WARNING nova.compute.manager [req-4f0dec59-6ed1-41ec-99e2-1c6b4cc34553 req-92126096-3432-4d62-9d87-25c476700e11 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received unexpected event network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 for instance with vm_state building and task_state spawning.
Aug 26 15:29:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693063755.6126683, e026b5a7-f19d-4eca-8e74-a5aa8089ed35 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:29:15 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] VM Resumed (Lifecycle Event)
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:29:15 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Instance spawned successfully.
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:29:15 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693063755.6164832, e026b5a7-f19d-4eca-8e74-a5aa8089ed35 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:29:15 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] VM Started (Lifecycle Event)
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-dd68b5b3-e26c-49b5-8315-5f57ef7eeb01 req-5816a705-05fc-4219-909e-7edf2d23957b service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received event network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dd68b5b3-e26c-49b5-8315-5f57ef7eeb01 req-5816a705-05fc-4219-909e-7edf2d23957b service nova] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dd68b5b3-e26c-49b5-8315-5f57ef7eeb01 req-5816a705-05fc-4219-909e-7edf2d23957b service nova] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-dd68b5b3-e26c-49b5-8315-5f57ef7eeb01 req-5816a705-05fc-4219-909e-7edf2d23957b service nova] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.compute.manager [req-dd68b5b3-e26c-49b5-8315-5f57ef7eeb01 req-5816a705-05fc-4219-909e-7edf2d23957b service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] No waiting events found dispatching network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:29:15 user nova-compute[73052]: WARNING nova.compute.manager [req-dd68b5b3-e26c-49b5-8315-5f57ef7eeb01 req-5816a705-05fc-4219-909e-7edf2d23957b service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received unexpected event network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 for instance with vm_state building and task_state spawning.
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:29:15 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:29:15 user nova-compute[73052]: INFO nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 26 15:29:15 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:29:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:16 user nova-compute[73052]: INFO nova.compute.manager [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Took 6.58 seconds to build instance.
Aug 26 15:29:16 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b0ab3092-8788-462d-adac-2a035b317dcd tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.681s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:29:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:29:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:29:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:29:32 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:29:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:29:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updating instance_info_cache with network_info: [{"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:29:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:29:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:29:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:29:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:36 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:42 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:45 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:29:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:29:46 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:29:46 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:29:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=25.093421936035156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:29:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:29:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:29:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:29:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:30:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:30:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:30:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:30:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:30:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:30:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:30:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:30:34 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:30:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:30:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:30:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:30:34 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:30:34 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:30:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updating instance_info_cache with network_info: [{"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:30:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:30:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:30:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:30:36 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:30:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:30:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:30:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:30:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:30:45 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:30:45 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:30:46 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:30:46 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:30:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=25.092792510986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:30:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:30:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:30:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:30:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:30:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e5d459d-4706-482b-8193-70208d217e06 req-c94fb367-a347-4ed5-8ecc-e5462b737ce0 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received event network-changed-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:31:00 user nova-compute[73052]: DEBUG nova.compute.manager [req-1e5d459d-4706-482b-8193-70208d217e06 req-c94fb367-a347-4ed5-8ecc-e5462b737ce0 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Refreshing instance network info cache due to event network-changed-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:31:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e5d459d-4706-482b-8193-70208d217e06 req-c94fb367-a347-4ed5-8ecc-e5462b737ce0 service nova] Acquiring lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:31:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e5d459d-4706-482b-8193-70208d217e06 req-c94fb367-a347-4ed5-8ecc-e5462b737ce0 service nova] Acquired lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:31:00 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e5d459d-4706-482b-8193-70208d217e06 req-c94fb367-a347-4ed5-8ecc-e5462b737ce0 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Refreshing network info cache for port e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:31:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:01 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e5d459d-4706-482b-8193-70208d217e06 req-c94fb367-a347-4ed5-8ecc-e5462b737ce0 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updated VIF entry in instance network info cache for port e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:31:01 user nova-compute[73052]: DEBUG nova.network.neutron [req-1e5d459d-4706-482b-8193-70208d217e06 req-c94fb367-a347-4ed5-8ecc-e5462b737ce0 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updating instance_info_cache with network_info: [{"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:31:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1e5d459d-4706-482b-8193-70208d217e06 req-c94fb367-a347-4ed5-8ecc-e5462b737ce0 service nova] Releasing lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:31:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:31:05 user nova-compute[73052]: INFO nova.compute.manager [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Attaching volume b1b17bc3-7940-4c16-a283-e0718b1c179a to /dev/vdb
Aug 26 15:31:05 user nova-compute[73052]: DEBUG os_brick.utils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:05 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ddc65a-7e51-4248-b0d3-bcf874902af4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b293ad41-ffe7-41a2-8455-3af7a64ac08e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba16dc7a-ee99-4bc2-b3b9-ad066068f216]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27bcb38-5a64-41c8-ade9-3a35270ce84d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:31:06 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:31:06 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[be538027-8579-4506-a4fd-9260fcc9b2a1]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG os_brick.utils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:31:06 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updating existing volume attachment record: cd1aaef9-4c16-4d24-b35a-e55e0e8c742b {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:31:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEnprcfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:31:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:31:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:31:16 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[362812e6-e4b7-4c5d-aee5-8d901387cd13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:31:16 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4356d4c-25ba-4890-80a8-bb2bd4edfa78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a] added
Aug 26 15:31:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[557999b5-e0ad-4b1c-8979-dbfe0ba1ef1a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfe945a-16fd-4324-ad9c-d12e72fca3e0]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEnprcfN {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEnprcfN" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc0f94-5988-4c7a-8ce0-de1614afb19a]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEnprcfN'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6acb86-72d2-48e2-80d2-b66c0ac28164]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[517e52d4-08cd-4ab8-8f49-46c436657917]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:31:16 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:31:16 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:31:16 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:31:16 user nova-compute[73052]: 
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7ec492-7893-4d75-a188-f14090bbb639]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a, portal: 172.16.0.220,3260]
Aug 26 15:31:16 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a, portal: 172.16.0.220,3260] successful.
Aug 26 15:31:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d8b871-3669-43eb-80b0-dca5d592ceb9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11901ad-b8b8-475e-bae7-f0a1e92a5ebe]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a (non-flash)
Aug 26 15:31:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a (non-flash)
Aug 26 15:31:16 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa4921-3ff8-42c9-965d-1a6f0316b46f]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:31:16 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEnprcfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23939343336656234', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939343336656234', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG nova.objects.instance [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:31:17 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:31:17 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:31:17 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:31:17 user nova-compute[73052]:   <serial>b1b17bc3-7940-4c16-a283-e0718b1c179a</serial>
Aug 26 15:31:17 user nova-compute[73052]: </disk>
Aug 26 15:31:17 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] No VIF found with MAC fa:16:3e:87:f3:e9, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:31:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-f7194b14-f61c-4ec0-b21a-b04e74054a3b tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.041s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:31:19 user nova-compute[73052]: INFO nova.compute.manager [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Detaching volume b1b17bc3-7940-4c16-a283-e0718b1c179a
Aug 26 15:31:19 user nova-compute[73052]: INFO nova.virt.block_device [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Attempting to driver detach volume b1b17bc3-7940-4c16-a283-e0718b1c179a from mountpoint /dev/vdb
Aug 26 15:31:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Attempting to detach device vdb from instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:31:19 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:31:19 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:31:19 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:31:19 user nova-compute[73052]:   <serial>b1b17bc3-7940-4c16-a283-e0718b1c179a</serial>
Aug 26 15:31:19 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:31:19 user nova-compute[73052]: </disk>
Aug 26 15:31:19 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:31:19 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully detached device vdb from instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35 from the persistent domain config.
Aug 26 15:31:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:31:19 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:31:19 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:31:19 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:31:19 user nova-compute[73052]:   <serial>b1b17bc3-7940-4c16-a283-e0718b1c179a</serial>
Aug 26 15:31:19 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:31:19 user nova-compute[73052]: </disk>
Aug 26 15:31:19 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693063879.5474188, e026b5a7-f19d-4eca-8e74-a5aa8089ed35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:31:19 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully detached device vdb from instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35 from the live domain config.
Aug 26 15:31:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEnprcfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:31:19 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a73f9f2-ef80-413c-b7e1-1e248ef0a992]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa308e-9172-4d24-8e5c-d713b4253b2c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a (non-flash)
Aug 26 15:31:19 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a (non-flash)
Aug 26 15:31:19 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc3b69-9c61-4d24-8cd1-69f3d2f9fc78]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[47237402-72fc-4984-a69f-2da240f14fa7]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b083cf0-f26f-4ae6-bd16-5745a4581526]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5276e0cb-bce4-4ce1-82d6-00feda32d090]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aafb20-7a00-4fe6-8544-9f6a4d5d0204]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[55333e47-8145-41fc-9831-40029c8bf14a]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a, portal: 172.16.0.220,3260]
Aug 26 15:31:19 user nova-compute[73052]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a, portal: 172.16.0.220,3260] successful.
Aug 26 15:31:19 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b17bc3-7940-4c16-a283-e0718b1c179a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4fd28a-73e4-46fe-88ba-92565dec387e]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] <== disconnect_volume: return (263ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:31:19 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:31:20 user nova-compute[73052]: DEBUG nova.objects.instance [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'flavor' on Instance uuid e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:31:20 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-cf0e505c-e20f-454e-b112-75d61d6c67f2 tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:31:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:31:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:31:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:31:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:31:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:31:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updating instance_info_cache with network_info: [{"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-e026b5a7-f19d-4eca-8e74-a5aa8089ed35" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:31:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:44 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:31:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:31:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:31:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:31:46 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:31:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:31:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=25.091777801513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:31:47 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:31:48 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:31:48 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:31:48 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:31:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:31:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:31:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:31:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:31:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:31:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:31:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:31:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:01 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:32:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:32:09 user nova-compute[73052]: INFO nova.compute.manager [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Terminating instance
Aug 26 15:32:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-1909c467-91ec-48a4-b3ba-b518678a777a req-9867a337-ea45-4896-b35e-1bc8d0050100 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received event network-vif-unplugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1909c467-91ec-48a4-b3ba-b518678a777a req-9867a337-ea45-4896-b35e-1bc8d0050100 service nova] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1909c467-91ec-48a4-b3ba-b518678a777a req-9867a337-ea45-4896-b35e-1bc8d0050100 service nova] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-1909c467-91ec-48a4-b3ba-b518678a777a req-9867a337-ea45-4896-b35e-1bc8d0050100 service nova] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-1909c467-91ec-48a4-b3ba-b518678a777a req-9867a337-ea45-4896-b35e-1bc8d0050100 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] No waiting events found dispatching network-vif-unplugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:32:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-1909c467-91ec-48a4-b3ba-b518678a777a req-9867a337-ea45-4896-b35e-1bc8d0050100 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received event network-vif-unplugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Instance destroyed successfully.
Aug 26 15:32:10 user nova-compute[73052]: DEBUG nova.objects.instance [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lazy-loading 'resources' on Instance uuid e026b5a7-f19d-4eca-8e74-a5aa8089ed35 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1462081888',display_name='tempest-AttachVolumeNegativeTest-server-1462081888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1462081888',id=51,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++JxxsXt706+uPBB9JCaehsmYBWFOzaXzr4+Qlv7Fp5ooDU9/HMjDPUhtJ1q/co562DgnlxSgBd+GavLEhwRJU8rF4/i0ne2zO8p5CF0B2ddxFTj2yItRpGHBax+3VLg==',key_name='tempest-keypair-682145588',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:29:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfbdfc74b3d74cc09c18b16504341125',ramdisk_id='',reservation_id='r-ikvrp5eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1607008473',owner_user_name='tempest-AttachVolumeNegativeTest-1607008473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c10396c807443083b436339dbb932a',uuid=e026b5a7-f19d-4eca-8e74-a5aa8089ed35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converting VIF {"id": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "address": "fa:16:3e:87:f3:e9", "network": {"id": "b18d10cc-3453-4673-98ee-44265927c208", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1099449435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbdfc74b3d74cc09c18b16504341125", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38ac794-17", "ovs_interfaceid": "e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:f3:e9,bridge_name='br-int',has_traffic_filtering=True,id=e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38ac794-17') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG os_vif [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f3:e9,bridge_name='br-int',has_traffic_filtering=True,id=e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38ac794-17') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape38ac794-17, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:10 user nova-compute[73052]: INFO os_vif [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f3:e9,bridge_name='br-int',has_traffic_filtering=True,id=e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7,network=Network(b18d10cc-3453-4673-98ee-44265927c208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38ac794-17')
Aug 26 15:32:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Deleting instance files /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35_del
Aug 26 15:32:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Deletion of /opt/stack/data/nova/instances/e026b5a7-f19d-4eca-8e74-a5aa8089ed35_del complete
Aug 26 15:32:10 user nova-compute[73052]: INFO nova.compute.manager [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 15:32:10 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:32:10 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:32:11 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Took 1.51 seconds to deallocate network for instance.
Aug 26 15:32:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-0cdfe228-2b94-4c61-9ab6-fef2890a1aa2 req-47e07e25-895b-4c09-9a69-fe1095c04dfa service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received event network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0cdfe228-2b94-4c61-9ab6-fef2890a1aa2 req-47e07e25-895b-4c09-9a69-fe1095c04dfa service nova] Acquiring lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0cdfe228-2b94-4c61-9ab6-fef2890a1aa2 req-47e07e25-895b-4c09-9a69-fe1095c04dfa service nova] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-0cdfe228-2b94-4c61-9ab6-fef2890a1aa2 req-47e07e25-895b-4c09-9a69-fe1095c04dfa service nova] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-0cdfe228-2b94-4c61-9ab6-fef2890a1aa2 req-47e07e25-895b-4c09-9a69-fe1095c04dfa service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] No waiting events found dispatching network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:32:11 user nova-compute[73052]: WARNING nova.compute.manager [req-0cdfe228-2b94-4c61-9ab6-fef2890a1aa2 req-47e07e25-895b-4c09-9a69-fe1095c04dfa service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received unexpected event network-vif-plugged-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 for instance with vm_state active and task_state deleting.
Aug 26 15:32:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-b6cfddbf-6627-4aa6-abbc-39d1498d5ae3 req-c6442e6e-56fd-483f-bdde-9f01f79e0314 service nova] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Received event network-vif-deleted-e38ac794-17ba-4e2c-a3a0-a5ceea0e08e7 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:32:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:32:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:32:12 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Deleted allocations for instance e026b5a7-f19d-4eca-8e74-a5aa8089ed35
Aug 26 15:32:12 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-1bc1fa3b-6a92-446d-8bcc-fec8d482675c tempest-AttachVolumeNegativeTest-1607008473 tempest-AttachVolumeNegativeTest-1607008473-project-member] Lock "e026b5a7-f19d-4eca-8e74-a5aa8089ed35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.746s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:32:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:32:12 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:32:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:32:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:25 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693063930.1497061, e026b5a7-f19d-4eca-8e74-a5aa8089ed35 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:32:25 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] VM Stopped (Lifecycle Event)
Aug 26 15:32:25 user nova-compute[73052]: DEBUG nova.compute.manager [None req-b61c7b87-4bdf-49e0-84cd-a308be864660 None None] [instance: e026b5a7-f19d-4eca-8e74-a5aa8089ed35] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:32:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:32:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:32:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:35 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:32:36 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:32:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:32:36 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:32:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:32:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:32:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:32:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:32:46 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:32:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:32:47 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:32:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.119022369384766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:32:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:32:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:32:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:32:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:32:47 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:32:47 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:32:47 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:32:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:32:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:32:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:32:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:32:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:32:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:32:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:33:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:33:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:33:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:33:38 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:33:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:33:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:33:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:33:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:42 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:33:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:33:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:33:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:33:48 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:33:49 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:33:49 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:33:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=9019MB free_disk=25.1092529296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:33:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:33:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:33:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:33:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:33:49 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:33:49 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:33:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:33:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:33:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:33:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:33:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:13 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:34:33 user nova-compute[73052]: INFO nova.compute.claims [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Claim successful on node user
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.network.neutron [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:34:33 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:34:33 user nova-compute[73052]: INFO nova.virt.block_device [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Booting with volume 914df318-6b98-4f7b-82e0-73bce4736522 at /dev/vda
Aug 26 15:34:33 user nova-compute[73052]: DEBUG nova.policy [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eca74c4907c1450e9ef6ee8adda351e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1325def78542d5b146036e955f341b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG os_brick.utils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fb035d-f3d2-4007-aee7-88769432ed34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c72ca1-10e0-4ae0-9f02-135df5d1302a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bea5ccf-b84b-4525-8ad0-242103793387]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a639da3-fb14-4b5a-8ac3-ad123720b918]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:34:34 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:34:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[400f55bd-3c4e-447b-9d2a-c9f7477d22be]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG os_brick.utils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating existing volume attachment record: 4040cdf6-83e6-4756-a537-ae88d674c5cf {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:34:34 user nova-compute[73052]: DEBUG nova.network.neutron [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Successfully created port: eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Successfully updated port: eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-cefde064-97ba-4a5e-b38c-35b39b99308d req-4c9f0066-bac1-420d-9539-ff56fb26d884 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-cefde064-97ba-4a5e-b38c-35b39b99308d req-4c9f0066-bac1-420d-9539-ff56fb26d884 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing instance network info cache due to event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cefde064-97ba-4a5e-b38c-35b39b99308d req-4c9f0066-bac1-420d-9539-ff56fb26d884 service nova] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG nova.network.neutron [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance network_info: |[{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cefde064-97ba-4a5e-b38c-35b39b99308d req-4c9f0066-bac1-420d-9539-ff56fb26d884 service nova] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:34:35 user nova-compute[73052]: DEBUG nova.network.neutron [req-cefde064-97ba-4a5e-b38c-35b39b99308d req-4c9f0066-bac1-420d-9539-ff56fb26d884 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:34:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:36 user nova-compute[73052]: DEBUG nova.network.neutron [req-cefde064-97ba-4a5e-b38c-35b39b99308d req-4c9f0066-bac1-420d-9539-ff56fb26d884 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updated VIF entry in instance network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:34:36 user nova-compute[73052]: DEBUG nova.network.neutron [req-cefde064-97ba-4a5e-b38c-35b39b99308d req-4c9f0066-bac1-420d-9539-ff56fb26d884 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:34:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-cefde064-97ba-4a5e-b38c-35b39b99308d req-4c9f0066-bac1-420d-9539-ff56fb26d884 service nova] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:34:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:37 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:34:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:34:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:34:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Skipping network cache update for instance because it is Building. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 15:34:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:34:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:41 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:34:44 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Creating image(s)
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Ensure instance console log exists: /opt/stack/data/nova/instances/c2d1ac95-9da9-435e-852a-60e983466abe/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Start _get_guest_xml network_info=[{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '4040cdf6-83e6-4756-a537-ae88d674c5cf', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBdvpNlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2d1ac95-9da9-435e-852a-60e983466abe', 'attached_at': '', 'detached_at': '', 'volume_id': '914df318-6b98-4f7b-82e0-73bce4736522', 'serial': '914df318-6b98-4f7b-82e0-73bce4736522'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:34:44 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:34:44 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBdvpNlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:34:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:34:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:34:44 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fdd110-2686-48aa-b7ee-ee5d4201135b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:34:44 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61deb32-44c7-4fd0-b691-b595476bbb8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522] added
Aug 26 15:34:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d25c62-f5ec-457a-ac4b-174c2976fa89]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b2677-f37c-475d-a699-4a64a251dad5]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBdvpNlo {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBdvpNlo" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f380a122-adc0-4876-adb7-04ede5c77ebc]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tBdvpNlo'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12f2325-f6b1-47a6-9f86-85b539ef1ad9]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beea7d5-fd68-4949-b01c-3351b2a1678e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:34:44 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:34:44 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:34:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:34:44 user nova-compute[73052]: 
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c5e45-5213-43b4-990b-650fc82faf7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260]
Aug 26 15:34:44 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260] successful.
Aug 26 15:34:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d2751b-6540-4065-9fbc-ab47d4ec4f2b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c953a81f-185d-4bf3-b594-b2166ad6f33a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)
Aug 26 15:34:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)
Aug 26 15:34:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6a65e2-fcd6-4816-a459-de3257808b9b]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:34:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBdvpNlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26162663639373637', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162663639373637', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-476134467',display_name='tempest-TestShelveInstance-server-476134467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-476134467',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBPkA83qqklM8y8ZzoIO0UDlouPnBI2Su593CWfjNo5pSebxJ+qRfPfiI0CmgWIYX93Z8MpW6u276O5jrwUgKK/Ef+h/Qzi2iW52dcqynIwXN75C/URxd5zr4WNR1gchA==',key_name='tempest-TestShelveInstance-1954867219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae1325def78542d5b146036e955f341b',ramdisk_id='',reservation_id='r-8n5ojlhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1968753790',owner_user_name='tempest-TestShelveInstance-1968753790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:34:34Z,user_data=None,user_id='eca74c4907c1450e9ef6ee8adda351e9',uuid=c2d1ac95-9da9-435e-852a-60e983466abe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converting VIF {"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lazy-loading 'pci_devices' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:34:45 user nova-compute[73052]:   <uuid>c2d1ac95-9da9-435e-852a-60e983466abe</uuid>
Aug 26 15:34:45 user nova-compute[73052]:   <name>instance-00000034</name>
Aug 26 15:34:45 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:34:45 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:34:45 user nova-compute[73052]:   <metadata>
Aug 26 15:34:45 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:34:45 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:34:45 user nova-compute[73052]:       <nova:name>tempest-TestShelveInstance-server-476134467</nova:name>
Aug 26 15:34:45 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:34:44</nova:creationTime>
Aug 26 15:34:45 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:34:45 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:34:45 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:34:45 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:34:45 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:34:45 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:34:45 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:34:45 user nova-compute[73052]:       <nova:owner>
Aug 26 15:34:45 user nova-compute[73052]:         <nova:user uuid="eca74c4907c1450e9ef6ee8adda351e9">tempest-TestShelveInstance-1968753790-project-member</nova:user>
Aug 26 15:34:45 user nova-compute[73052]:         <nova:project uuid="ae1325def78542d5b146036e955f341b">tempest-TestShelveInstance-1968753790</nova:project>
Aug 26 15:34:45 user nova-compute[73052]:       </nova:owner>
Aug 26 15:34:45 user nova-compute[73052]:       <nova:ports>
Aug 26 15:34:45 user nova-compute[73052]:         <nova:port uuid="eebb8615-5e1f-4259-b5fa-8d783270aa9c">
Aug 26 15:34:45 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 15:34:45 user nova-compute[73052]:         </nova:port>
Aug 26 15:34:45 user nova-compute[73052]:       </nova:ports>
Aug 26 15:34:45 user nova-compute[73052]:     </nova:instance>
Aug 26 15:34:45 user nova-compute[73052]:   </metadata>
Aug 26 15:34:45 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:34:45 user nova-compute[73052]:     <system>
Aug 26 15:34:45 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:34:45 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:34:45 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:34:45 user nova-compute[73052]:       <entry name="serial">c2d1ac95-9da9-435e-852a-60e983466abe</entry>
Aug 26 15:34:45 user nova-compute[73052]:       <entry name="uuid">c2d1ac95-9da9-435e-852a-60e983466abe</entry>
Aug 26 15:34:45 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:34:45 user nova-compute[73052]:     </system>
Aug 26 15:34:45 user nova-compute[73052]:   </sysinfo>
Aug 26 15:34:45 user nova-compute[73052]:   <os>
Aug 26 15:34:45 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:34:45 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:34:45 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:34:45 user nova-compute[73052]:   </os>
Aug 26 15:34:45 user nova-compute[73052]:   <features>
Aug 26 15:34:45 user nova-compute[73052]:     <acpi/>
Aug 26 15:34:45 user nova-compute[73052]:     <apic/>
Aug 26 15:34:45 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:34:45 user nova-compute[73052]:   </features>
Aug 26 15:34:45 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:34:45 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:34:45 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:34:45 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:34:45 user nova-compute[73052]:   </clock>
Aug 26 15:34:45 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:34:45 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:34:45 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:34:45 user nova-compute[73052]:   </cpu>
Aug 26 15:34:45 user nova-compute[73052]:   <devices>
Aug 26 15:34:45 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:34:45 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:34:45 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 15:34:45 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:34:45 user nova-compute[73052]:       <serial>914df318-6b98-4f7b-82e0-73bce4736522</serial>
Aug 26 15:34:45 user nova-compute[73052]:     </disk>
Aug 26 15:34:45 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:34:45 user nova-compute[73052]:       <mac address="fa:16:3e:3e:45:e6"/>
Aug 26 15:34:45 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:34:45 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:34:45 user nova-compute[73052]:       <target dev="tapeebb8615-5e"/>
Aug 26 15:34:45 user nova-compute[73052]:     </interface>
Aug 26 15:34:45 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:34:45 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/c2d1ac95-9da9-435e-852a-60e983466abe/console.log" append="off"/>
Aug 26 15:34:45 user nova-compute[73052]:     </serial>
Aug 26 15:34:45 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:34:45 user nova-compute[73052]:     <video>
Aug 26 15:34:45 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:34:45 user nova-compute[73052]:     </video>
Aug 26 15:34:45 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:34:45 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:34:45 user nova-compute[73052]:     </rng>
Aug 26 15:34:45 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:34:45 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:34:45 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:34:45 user nova-compute[73052]:     </memballoon>
Aug 26 15:34:45 user nova-compute[73052]:   </devices>
Aug 26 15:34:45 user nova-compute[73052]: </domain>
Aug 26 15:34:45 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-476134467',display_name='tempest-TestShelveInstance-server-476134467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-476134467',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBPkA83qqklM8y8ZzoIO0UDlouPnBI2Su593CWfjNo5pSebxJ+qRfPfiI0CmgWIYX93Z8MpW6u276O5jrwUgKK/Ef+h/Qzi2iW52dcqynIwXN75C/URxd5zr4WNR1gchA==',key_name='tempest-TestShelveInstance-1954867219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae1325def78542d5b146036e955f341b',ramdisk_id='',reservation_id='r-8n5ojlhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1968753790',owner_user_name='tempest-TestShelveInstance-1968753790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:34:34Z,user_data=None,user_id='eca74c4907c1450e9ef6ee8adda351e9',uuid=c2d1ac95-9da9-435e-852a-60e983466abe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converting VIF {"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG os_vif [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeebb8615-5e, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeebb8615-5e, col_values=(('external_ids', {'iface-id': 'eebb8615-5e1f-4259-b5fa-8d783270aa9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:45:e6', 'vm-uuid': 'c2d1ac95-9da9-435e-852a-60e983466abe'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:45 user nova-compute[73052]: INFO os_vif [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e')
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:34:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] No VIF found with MAC fa:16:3e:3e:45:e6, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:34:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-65ed9760-712a-480f-b9c0-f93df13b5730 req-d32f712c-63c6-4afd-af56-e4045dfa19e9 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-65ed9760-712a-480f-b9c0-f93df13b5730 req-d32f712c-63c6-4afd-af56-e4045dfa19e9 service nova] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-65ed9760-712a-480f-b9c0-f93df13b5730 req-d32f712c-63c6-4afd-af56-e4045dfa19e9 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-65ed9760-712a-480f-b9c0-f93df13b5730 req-d32f712c-63c6-4afd-af56-e4045dfa19e9 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG nova.compute.manager [req-65ed9760-712a-480f-b9c0-f93df13b5730 req-d32f712c-63c6-4afd-af56-e4045dfa19e9 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] No waiting events found dispatching network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:34:47 user nova-compute[73052]: WARNING nova.compute.manager [req-65ed9760-712a-480f-b9c0-f93df13b5730 req-d32f712c-63c6-4afd-af56-e4045dfa19e9 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received unexpected event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c for instance with vm_state building and task_state spawning.
Aug 26 15:34:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:34:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:34:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:34:48 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:34:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693064089.0852032, c2d1ac95-9da9-435e-852a-60e983466abe => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:34:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] VM Resumed (Lifecycle Event)
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-6b5f1036-bc43-4a80-89d4-2efeb7ecc6ab req-eca73b6e-0c1d-4385-aca9-ccba19e0dc0e service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6b5f1036-bc43-4a80-89d4-2efeb7ecc6ab req-eca73b6e-0c1d-4385-aca9-ccba19e0dc0e service nova] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6b5f1036-bc43-4a80-89d4-2efeb7ecc6ab req-eca73b6e-0c1d-4385-aca9-ccba19e0dc0e service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-6b5f1036-bc43-4a80-89d4-2efeb7ecc6ab req-eca73b6e-0c1d-4385-aca9-ccba19e0dc0e service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.manager [req-6b5f1036-bc43-4a80-89d4-2efeb7ecc6ab req-eca73b6e-0c1d-4385-aca9-ccba19e0dc0e service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] No waiting events found dispatching network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:34:49 user nova-compute[73052]: WARNING nova.compute.manager [req-6b5f1036-bc43-4a80-89d4-2efeb7ecc6ab req-eca73b6e-0c1d-4385-aca9-ccba19e0dc0e service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received unexpected event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c for instance with vm_state building and task_state spawning.
Aug 26 15:34:49 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance spawned successfully.
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:34:49 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:34:49 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.106060028076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:34:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693064089.0862246, c2d1ac95-9da9-435e-852a-60e983466abe => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:34:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] VM Started (Lifecycle Event)
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c2d1ac95-9da9-435e-852a-60e983466abe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:34:49 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:34:49 user nova-compute[73052]: INFO nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Took 5.11 seconds to spawn the instance on the hypervisor.
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:34:49 user nova-compute[73052]: INFO nova.compute.manager [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Took 16.01 seconds to build instance.
Aug 26 15:34:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:34:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-4b782c76-ee84-4120-a8b1-588b64ddf5b0 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.112s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:34:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:34:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:34:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:35:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:35:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:35:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:35:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:08 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:35:38 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:38 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:35:40 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:35:41 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:35:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:35:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:35:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:35:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:35:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:35:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:35:49 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:35:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:35:50 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:35:50 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:35:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.10527801513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c2d1ac95-9da9-435e-852a-60e983466abe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:35:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:35:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:35:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:36:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:36:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:36:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:36:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:36:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:36:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:36:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:36:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:36:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:36:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG nova.compute.manager [req-8b749bba-a731-4a23-a5bc-875868295bfd req-49db33ed-0e04-454c-8d70-a9c3f70f372e service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG nova.compute.manager [req-8b749bba-a731-4a23-a5bc-875868295bfd req-49db33ed-0e04-454c-8d70-a9c3f70f372e service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing instance network info cache due to event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8b749bba-a731-4a23-a5bc-875868295bfd req-49db33ed-0e04-454c-8d70-a9c3f70f372e service nova] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8b749bba-a731-4a23-a5bc-875868295bfd req-49db33ed-0e04-454c-8d70-a9c3f70f372e service nova] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG nova.network.neutron [req-8b749bba-a731-4a23-a5bc-875868295bfd req-49db33ed-0e04-454c-8d70-a9c3f70f372e service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:36:25 user nova-compute[73052]: INFO nova.compute.manager [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Shelve offloading
Aug 26 15:36:25 user nova-compute[73052]: DEBUG nova.network.neutron [req-8b749bba-a731-4a23-a5bc-875868295bfd req-49db33ed-0e04-454c-8d70-a9c3f70f372e service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updated VIF entry in instance network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG nova.network.neutron [req-8b749bba-a731-4a23-a5bc-875868295bfd req-49db33ed-0e04-454c-8d70-a9c3f70f372e service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:36:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8b749bba-a731-4a23-a5bc-875868295bfd req-49db33ed-0e04-454c-8d70-a9c3f70f372e service nova] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-856f5144-8579-43b3-a15b-aa6e27d0cc84 req-4922bf5a-1ee4-47b5-a0b5-e84eeac3f0fa service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-unplugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-856f5144-8579-43b3-a15b-aa6e27d0cc84 req-4922bf5a-1ee4-47b5-a0b5-e84eeac3f0fa service nova] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-856f5144-8579-43b3-a15b-aa6e27d0cc84 req-4922bf5a-1ee4-47b5-a0b5-e84eeac3f0fa service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-856f5144-8579-43b3-a15b-aa6e27d0cc84 req-4922bf5a-1ee4-47b5-a0b5-e84eeac3f0fa service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG nova.compute.manager [req-856f5144-8579-43b3-a15b-aa6e27d0cc84 req-4922bf5a-1ee4-47b5-a0b5-e84eeac3f0fa service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] No waiting events found dispatching network-vif-unplugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:36:26 user nova-compute[73052]: WARNING nova.compute.manager [req-856f5144-8579-43b3-a15b-aa6e27d0cc84 req-4922bf5a-1ee4-47b5-a0b5-e84eeac3f0fa service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received unexpected event network-vif-unplugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c for instance with vm_state active and task_state shelving.
Aug 26 15:36:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:26 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance destroyed successfully.
Aug 26 15:36:26 user nova-compute[73052]: DEBUG nova.compute.manager [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:36:26 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG nova.network.neutron [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance destroyed successfully.
Aug 26 15:36:27 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lazy-loading 'resources' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-476134467',display_name='tempest-TestShelveInstance-server-476134467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-476134467',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBPkA83qqklM8y8ZzoIO0UDlouPnBI2Su593CWfjNo5pSebxJ+qRfPfiI0CmgWIYX93Z8MpW6u276O5jrwUgKK/Ef+h/Qzi2iW52dcqynIwXN75C/URxd5zr4WNR1gchA==',key_name='tempest-TestShelveInstance-1954867219',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae1325def78542d5b146036e955f341b',ramdisk_id='',reservation_id='r-8n5ojlhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1968753790',owner_user_name='tempest-TestShelveInstance-1968753790-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:34:49Z,user_data=None,user_id='eca74c4907c1450e9ef6ee8adda351e9',uuid=c2d1ac95-9da9-435e-852a-60e983466abe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converting VIF {"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_vif [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeebb8615-5e, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:27 user nova-compute[73052]: INFO os_vif [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e')
Aug 26 15:36:27 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBdvpNlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:36:27 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e6c715-aa16-481f-87a1-f84c60b24740]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bdb8b5-2dcb-4664-8a6b-ddb91a13b0f9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)
Aug 26 15:36:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)
Aug 26 15:36:27 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a813d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff719afc-d7b4-4c1a-b8bd-ae95a140443f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[363445ed-4a0d-4938-aee1-c13a4d29b334]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaec2fb-c5e2-41d1-a6d2-6f7dfa104747]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d24657-5f57-4cab-85b6-46d009bb7a26]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d42912-9e94-4b49-a953-113f5de2cbdd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:36:27 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0ddde0-cd10-4977-b581-e5d4091adebf]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260]
Aug 26 15:36:28 user nova-compute[73052]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260] successful.
Aug 26 15:36:28 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecc0638-49b9-424d-b6b7-11bdd46a55eb]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] <== disconnect_volume: return (270ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:36:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Deleting instance files /opt/stack/data/nova/instances/c2d1ac95-9da9-435e-852a-60e983466abe_del
Aug 26 15:36:28 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Deletion of /opt/stack/data/nova/instances/c2d1ac95-9da9-435e-852a-60e983466abe_del complete
Aug 26 15:36:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] No waiting events found dispatching network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:36:28 user nova-compute[73052]: WARNING nova.compute.manager [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received unexpected event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c for instance with vm_state active and task_state shelving.
Aug 26 15:36:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG nova.compute.manager [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing instance network info cache due to event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updated VIF entry in instance network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG nova.network.neutron [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": null, "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapeebb8615-5e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:36:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-b0b145da-67da-4efc-b81e-b2dd60e0ae7a req-0fea4646-b2f6-493f-87b3-4d0594a18c89 service nova] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:36:29 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Deleted allocations for instance c2d1ac95-9da9-435e-852a-60e983466abe
Aug 26 15:36:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:36:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:36:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lazy-loading 'numa_topology' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:36:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Object Instance<c2d1ac95-9da9-435e-852a-60e983466abe> lazy-loaded attributes: resources,numa_topology {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:36:29 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:36:29 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:36:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.099s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:36:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-7bc77455-5b60-4426-9f32-2ae6153cb2fa tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.363s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:36:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:36:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:41 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693064186.6794543, c2d1ac95-9da9-435e-852a-60e983466abe => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:36:41 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] VM Stopped (Lifecycle Event)
Aug 26 15:36:41 user nova-compute[73052]: DEBUG nova.compute.manager [None req-adab43de-d179-469c-8735-6fd79c5f3ac1 None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:36:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:42 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:36:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:36:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:36:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:36:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:36:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:36:50 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:36:51 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:36:51 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.10439682006836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:36:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:36:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:36:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:36:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:03 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:37:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:37:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:12 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:37:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:37:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:37:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:37:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:37:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:37:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:37:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:37:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:37:39 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:39 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:37:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:44 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:37:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:37:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:37:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:37:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:37:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:37:51 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:37:52 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:37:52 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:37:52 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=25.103870391845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:37:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:37:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:37:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:38:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:38:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:38:17 user nova-compute[73052]: INFO nova.compute.manager [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Unshelving
Aug 26 15:38:17 user nova-compute[73052]: INFO nova.virt.block_device [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Booting with volume 914df318-6b98-4f7b-82e0-73bce4736522 at /dev/vda
Aug 26 15:38:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG os_brick.utils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a701cc-c2c0-4ee6-9131-503ddd105a1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98aa468-ff89-4c94-b36e-317abcf5950b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e979ddae-396e-43d6-bffb-0ac1268ea7cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76bbc59-c767-4772-8ac6-72c3adfa82a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:17 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:38:18 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:38:18 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fd6a2e-876f-4a0e-96e5-3b076f0b110f]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG os_brick.utils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] <== get_connector_properties: return (267ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:38:18 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating existing volume attachment record: 8d72a8bd-2bc9-4e7e-9f56-251d33aa4970 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:38:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:38:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:38:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lazy-loading 'pci_requests' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:38:28 user nova-compute[73052]: DEBUG nova.objects.instance [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lazy-loading 'numa_topology' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:38:28 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:38:28 user nova-compute[73052]: INFO nova.compute.claims [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Claim successful on node user
Aug 26 15:38:28 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:38:28 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:38:28 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:38:28 user nova-compute[73052]: INFO nova.network.neutron [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating port eebb8615-5e1f-4259-b5fa-8d783270aa9c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-c2b5b881-c801-49dc-8b90-7d372999f7e2 req-516fdf79-471c-444b-9bc6-90481446e29a service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.compute.manager [req-c2b5b881-c801-49dc-8b90-7d372999f7e2 req-516fdf79-471c-444b-9bc6-90481446e29a service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing instance network info cache due to event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c2b5b881-c801-49dc-8b90-7d372999f7e2 req-516fdf79-471c-444b-9bc6-90481446e29a service nova] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.network.neutron [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:38:29 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Creating image(s)
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Did not create local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Ensure instance console log exists: /opt/stack/data/nova/instances/c2d1ac95-9da9-435e-852a-60e983466abe/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Start _get_guest_xml network_info=[{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '8d72a8bd-2bc9-4e7e-9f56-251d33aa4970', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBdvpNlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2d1ac95-9da9-435e-852a-60e983466abe', 'attached_at': '', 'detached_at': '', 'volume_id': '914df318-6b98-4f7b-82e0-73bce4736522', 'serial': '914df318-6b98-4f7b-82e0-73bce4736522'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c2b5b881-c801-49dc-8b90-7d372999f7e2 req-516fdf79-471c-444b-9bc6-90481446e29a service nova] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.network.neutron [req-c2b5b881-c801-49dc-8b90-7d372999f7e2 req-516fdf79-471c-444b-9bc6-90481446e29a service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:38:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:38:29 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.objects.instance [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.objects.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Object Instance<c2d1ac95-9da9-435e-852a-60e983466abe> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBdvpNlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:38:29 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:38:29 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:38:29 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3455129-5bfb-4b31-9ab6-942163d21e1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:38:29 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0ca9ed-fae3-4efe-976e-0c80dc5947c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522] added
Aug 26 15:38:29 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69e1216-0bd2-4a46-9fb4-01c159c4ffc3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec7b5f-e022-40c7-8fbd-0424839de38d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:38:29 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBdvpNlo {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBdvpNlo" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ae623f-633b-434b-98b6-72fbd04c78b1]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tBdvpNlo'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3136ca-f0b2-424d-86b1-bbc20a99e070]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1255fc-45d9-4839-a357-9ead374c502b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:38:30 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:38:30 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:38:30 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:38:30 user nova-compute[73052]: 
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed3b48-c475-42fb-8294-7d6516dca1af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260]
Aug 26 15:38:30 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260] successful.
Aug 26 15:38:30 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd70a0a-75c1-4df2-8247-75444f8ce624]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[572fa633-b808-4163-9096-d468a163f666]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)
Aug 26 15:38:30 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)
Aug 26 15:38:30 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7168e1d-e280-4ba8-96c0-94d5a93763a0]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBdvpNlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG nova.network.neutron [req-c2b5b881-c801-49dc-8b90-7d372999f7e2 req-516fdf79-471c-444b-9bc6-90481446e29a service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updated VIF entry in instance network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG nova.network.neutron [req-c2b5b881-c801-49dc-8b90-7d372999f7e2 req-516fdf79-471c-444b-9bc6-90481446e29a service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:38:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c2b5b881-c801-49dc-8b90-7d372999f7e2 req-516fdf79-471c-444b-9bc6-90481446e29a service nova] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26162663639373637', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162663639373637', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-476134467',display_name='tempest-TestShelveInstance-server-476134467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-476134467',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1954867219',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae1325def78542d5b146036e955f341b',ramdisk_id='',reservation_id='r-8n5ojlhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1968753790',owner_user_name='tempest-TestShelveInstance-1968753790-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:38:18Z,user_data=None,user_id='eca74c4907c1450e9ef6ee8adda351e9',uuid=c2d1ac95-9da9-435e-852a-60e983466abe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converting VIF {"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.objects.instance [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lazy-loading 'pci_devices' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.objects.base [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Object Instance<c2d1ac95-9da9-435e-852a-60e983466abe> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73052) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:38:31 user nova-compute[73052]:   <uuid>c2d1ac95-9da9-435e-852a-60e983466abe</uuid>
Aug 26 15:38:31 user nova-compute[73052]:   <name>instance-00000034</name>
Aug 26 15:38:31 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:38:31 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:38:31 user nova-compute[73052]:   <metadata>
Aug 26 15:38:31 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:38:31 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:38:31 user nova-compute[73052]:       <nova:name>tempest-TestShelveInstance-server-476134467</nova:name>
Aug 26 15:38:31 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:38:29</nova:creationTime>
Aug 26 15:38:31 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:38:31 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:38:31 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:38:31 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:38:31 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:38:31 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:38:31 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:38:31 user nova-compute[73052]:       <nova:owner>
Aug 26 15:38:31 user nova-compute[73052]:         <nova:user uuid="eca74c4907c1450e9ef6ee8adda351e9">tempest-TestShelveInstance-1968753790-project-member</nova:user>
Aug 26 15:38:31 user nova-compute[73052]:         <nova:project uuid="ae1325def78542d5b146036e955f341b">tempest-TestShelveInstance-1968753790</nova:project>
Aug 26 15:38:31 user nova-compute[73052]:       </nova:owner>
Aug 26 15:38:31 user nova-compute[73052]:       <nova:ports>
Aug 26 15:38:31 user nova-compute[73052]:         <nova:port uuid="eebb8615-5e1f-4259-b5fa-8d783270aa9c">
Aug 26 15:38:31 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 15:38:31 user nova-compute[73052]:         </nova:port>
Aug 26 15:38:31 user nova-compute[73052]:       </nova:ports>
Aug 26 15:38:31 user nova-compute[73052]:     </nova:instance>
Aug 26 15:38:31 user nova-compute[73052]:   </metadata>
Aug 26 15:38:31 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:38:31 user nova-compute[73052]:     <system>
Aug 26 15:38:31 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:38:31 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:38:31 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:38:31 user nova-compute[73052]:       <entry name="serial">c2d1ac95-9da9-435e-852a-60e983466abe</entry>
Aug 26 15:38:31 user nova-compute[73052]:       <entry name="uuid">c2d1ac95-9da9-435e-852a-60e983466abe</entry>
Aug 26 15:38:31 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:38:31 user nova-compute[73052]:     </system>
Aug 26 15:38:31 user nova-compute[73052]:   </sysinfo>
Aug 26 15:38:31 user nova-compute[73052]:   <os>
Aug 26 15:38:31 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:38:31 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:38:31 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:38:31 user nova-compute[73052]:   </os>
Aug 26 15:38:31 user nova-compute[73052]:   <features>
Aug 26 15:38:31 user nova-compute[73052]:     <acpi/>
Aug 26 15:38:31 user nova-compute[73052]:     <apic/>
Aug 26 15:38:31 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:38:31 user nova-compute[73052]:   </features>
Aug 26 15:38:31 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:38:31 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:38:31 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:38:31 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:38:31 user nova-compute[73052]:   </clock>
Aug 26 15:38:31 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:38:31 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:38:31 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:38:31 user nova-compute[73052]:   </cpu>
Aug 26 15:38:31 user nova-compute[73052]:   <devices>
Aug 26 15:38:31 user nova-compute[73052]:     <disk type="block" device="disk">
Aug 26 15:38:31 user nova-compute[73052]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:38:31 user nova-compute[73052]:       <source dev="/dev/sdb"/>
Aug 26 15:38:31 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:38:31 user nova-compute[73052]:       <serial>914df318-6b98-4f7b-82e0-73bce4736522</serial>
Aug 26 15:38:31 user nova-compute[73052]:     </disk>
Aug 26 15:38:31 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:38:31 user nova-compute[73052]:       <mac address="fa:16:3e:3e:45:e6"/>
Aug 26 15:38:31 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:38:31 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:38:31 user nova-compute[73052]:       <target dev="tapeebb8615-5e"/>
Aug 26 15:38:31 user nova-compute[73052]:     </interface>
Aug 26 15:38:31 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:38:31 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/c2d1ac95-9da9-435e-852a-60e983466abe/console.log" append="off"/>
Aug 26 15:38:31 user nova-compute[73052]:     </serial>
Aug 26 15:38:31 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:38:31 user nova-compute[73052]:     <video>
Aug 26 15:38:31 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:38:31 user nova-compute[73052]:     </video>
Aug 26 15:38:31 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:38:31 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:38:31 user nova-compute[73052]:     </rng>
Aug 26 15:38:31 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:38:31 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:38:31 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:38:31 user nova-compute[73052]:     </memballoon>
Aug 26 15:38:31 user nova-compute[73052]:   </devices>
Aug 26 15:38:31 user nova-compute[73052]: </domain>
Aug 26 15:38:31 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-476134467',display_name='tempest-TestShelveInstance-server-476134467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-476134467',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1954867219',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae1325def78542d5b146036e955f341b',ramdisk_id='',reservation_id='r-8n5ojlhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1968753790',owner_user_name='tempest-TestShelveInstance-1968753790-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:38:18Z,user_data=None,user_id='eca74c4907c1450e9ef6ee8adda351e9',uuid=c2d1ac95-9da9-435e-852a-60e983466abe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converting VIF {"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG os_vif [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeebb8615-5e, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeebb8615-5e, col_values=(('external_ids', {'iface-id': 'eebb8615-5e1f-4259-b5fa-8d783270aa9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:45:e6', 'vm-uuid': 'c2d1ac95-9da9-435e-852a-60e983466abe'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:31 user nova-compute[73052]: INFO os_vif [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e')
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:38:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] No VIF found with MAC fa:16:3e:3e:45:e6, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:38:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-4531f412-4b8c-4360-b96f-656d7a93a91c req-8926ced0-5497-4529-8603-323b8be09d04 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:38:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4531f412-4b8c-4360-b96f-656d7a93a91c req-8926ced0-5497-4529-8603-323b8be09d04 service nova] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:38:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4531f412-4b8c-4360-b96f-656d7a93a91c req-8926ced0-5497-4529-8603-323b8be09d04 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:38:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-4531f412-4b8c-4360-b96f-656d7a93a91c req-8926ced0-5497-4529-8603-323b8be09d04 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:38:32 user nova-compute[73052]: DEBUG nova.compute.manager [req-4531f412-4b8c-4360-b96f-656d7a93a91c req-8926ced0-5497-4529-8603-323b8be09d04 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] No waiting events found dispatching network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:38:32 user nova-compute[73052]: WARNING nova.compute.manager [req-4531f412-4b8c-4360-b96f-656d7a93a91c req-8926ced0-5497-4529-8603-323b8be09d04 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received unexpected event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 15:38:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693064314.6251373, c2d1ac95-9da9-435e-852a-60e983466abe => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:38:34 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] VM Resumed (Lifecycle Event)
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:38:34 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance spawned successfully.
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:38:34 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693064314.6284993, c2d1ac95-9da9-435e-852a-60e983466abe => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:38:34 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] VM Started (Lifecycle Event)
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-907b1433-92e3-4443-bf3b-e6e30b11390a tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.138s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-8e1abbc5-1d28-452a-9944-646e13f89517 req-9219f3b8-87c8-4cf3-8deb-99db4242fab0 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8e1abbc5-1d28-452a-9944-646e13f89517 req-9219f3b8-87c8-4cf3-8deb-99db4242fab0 service nova] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8e1abbc5-1d28-452a-9944-646e13f89517 req-9219f3b8-87c8-4cf3-8deb-99db4242fab0 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-8e1abbc5-1d28-452a-9944-646e13f89517 req-9219f3b8-87c8-4cf3-8deb-99db4242fab0 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:38:34 user nova-compute[73052]: DEBUG nova.compute.manager [req-8e1abbc5-1d28-452a-9944-646e13f89517 req-9219f3b8-87c8-4cf3-8deb-99db4242fab0 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] No waiting events found dispatching network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:38:34 user nova-compute[73052]: WARNING nova.compute.manager [req-8e1abbc5-1d28-452a-9944-646e13f89517 req-9219f3b8-87c8-4cf3-8deb-99db4242fab0 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received unexpected event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c for instance with vm_state active and task_state None.
Aug 26 15:38:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:38:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:38:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:38:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:38:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:38:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:38:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:38:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:38:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:38:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:38:45 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:38:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:38:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:38:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:38:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:38:53 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:38:53 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:38:54 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:38:54 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:38:54 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.102340698242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c2d1ac95-9da9-435e-852a-60e983466abe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:38:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:38:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:38:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:39:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:39:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:39:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:39:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:39:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:39:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:39:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:39:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:39:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:39:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:40 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:40 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:39:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:45 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:39:45 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:39:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:39:45 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:39:45 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:39:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:39:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:54 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:39:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:39:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:39:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:39:54 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:39:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73052) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 15:39:55 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:39:55 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:39:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.101688385009766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance c2d1ac95-9da9-435e-852a-60e983466abe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:39:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:39:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:39:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:39:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:39:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:39:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:39:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:40:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:40:08 user nova-compute[73052]: INFO nova.compute.manager [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Terminating instance
Aug 26 15:40:08 user nova-compute[73052]: DEBUG nova.compute.manager [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-e69cdaa9-ab5e-417a-b484-af9a0dbd96e4 req-c09777f9-203e-41bf-870e-c54955131c62 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG nova.compute.manager [req-e69cdaa9-ab5e-417a-b484-af9a0dbd96e4 req-c09777f9-203e-41bf-870e-c54955131c62 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing instance network info cache due to event network-changed-eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e69cdaa9-ab5e-417a-b484-af9a0dbd96e4 req-c09777f9-203e-41bf-870e-c54955131c62 service nova] Acquiring lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e69cdaa9-ab5e-417a-b484-af9a0dbd96e4 req-c09777f9-203e-41bf-870e-c54955131c62 service nova] Acquired lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:40:08 user nova-compute[73052]: DEBUG nova.network.neutron [req-e69cdaa9-ab5e-417a-b484-af9a0dbd96e4 req-c09777f9-203e-41bf-870e-c54955131c62 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Refreshing network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-673652f8-08c1-4eac-99b2-a9a79edc5012 req-fbc7b751-618c-42bf-9825-aaad36289bb8 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-unplugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-673652f8-08c1-4eac-99b2-a9a79edc5012 req-fbc7b751-618c-42bf-9825-aaad36289bb8 service nova] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-673652f8-08c1-4eac-99b2-a9a79edc5012 req-fbc7b751-618c-42bf-9825-aaad36289bb8 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-673652f8-08c1-4eac-99b2-a9a79edc5012 req-fbc7b751-618c-42bf-9825-aaad36289bb8 service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-673652f8-08c1-4eac-99b2-a9a79edc5012 req-fbc7b751-618c-42bf-9825-aaad36289bb8 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] No waiting events found dispatching network-vif-unplugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.compute.manager [req-673652f8-08c1-4eac-99b2-a9a79edc5012 req-fbc7b751-618c-42bf-9825-aaad36289bb8 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-unplugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:09 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Instance destroyed successfully.
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.objects.instance [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lazy-loading 'resources' on Instance uuid c2d1ac95-9da9-435e-852a-60e983466abe {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-476134467',display_name='tempest-TestShelveInstance-server-476134467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-476134467',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBPkA83qqklM8y8ZzoIO0UDlouPnBI2Su593CWfjNo5pSebxJ+qRfPfiI0CmgWIYX93Z8MpW6u276O5jrwUgKK/Ef+h/Qzi2iW52dcqynIwXN75C/URxd5zr4WNR1gchA==',key_name='tempest-TestShelveInstance-1954867219',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:38:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae1325def78542d5b146036e955f341b',ramdisk_id='',reservation_id='r-8n5ojlhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1968753790',owner_user_name='tempest-TestShelveInstance-1968753790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:38:35Z,user_data=None,user_id='eca74c4907c1450e9ef6ee8adda351e9',uuid=c2d1ac95-9da9-435e-852a-60e983466abe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converting VIF {"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_vif [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeebb8615-5e, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:40:09 user nova-compute[73052]: INFO os_vif [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:45:e6,bridge_name='br-int',has_traffic_filtering=True,id=eebb8615-5e1f-4259-b5fa-8d783270aa9c,network=Network(e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebb8615-5e')
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.network.neutron [req-e69cdaa9-ab5e-417a-b484-af9a0dbd96e4 req-c09777f9-203e-41bf-870e-c54955131c62 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updated VIF entry in instance network info cache for port eebb8615-5e1f-4259-b5fa-8d783270aa9c. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.network.neutron [req-e69cdaa9-ab5e-417a-b484-af9a0dbd96e4 req-c09777f9-203e-41bf-870e-c54955131c62 service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [{"id": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "address": "fa:16:3e:3e:45:e6", "network": {"id": "e2dedb0d-de61-4d2d-8f1a-62aaf5fe6026", "bridge": "br-int", "label": "tempest-TestShelveInstance-2094523998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1325def78542d5b146036e955f341b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebb8615-5e", "ovs_interfaceid": "eebb8615-5e1f-4259-b5fa-8d783270aa9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBdvpNlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:40:09 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-e69cdaa9-ab5e-417a-b484-af9a0dbd96e4 req-c09777f9-203e-41bf-870e-c54955131c62 service nova] Releasing lock "refresh_cache-c2d1ac95-9da9-435e-852a-60e983466abe" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[565b6ea4-db8a-4998-b405-156a2a5fb910]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa78189-4b47-4f7c-ad2f-ec0a4bb36ac4]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)
Aug 26 15:40:09 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 (non-flash)
Aug 26 15:40:09 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a8265900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3030102c-47c6-4653-ad2a-b731302b79d9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca1777-b40a-4c7b-b77b-9428fefeef0f]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b425def-4d4f-4d15-b3bc-08c57830b50f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:40:09 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd908835-2212-4c33-8f36-7f511a533e35]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fbaed7d3', '/dev/disk/by-id/scsi-26162663639373637', '/dev/disk/by-id/scsi-1SCST_BIOfbaed7d3-abf6976755484c63') {{(pid=84351) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b3a364-45cc-479f-a251-382a26ab1a23]: (4, None) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0516cfed-95c9-4bbe-9480-5887e942742c]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e604206-ef62-43b7-a71d-f1e0c80d05c7]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260]
Aug 26 15:40:10 user nova-compute[73052]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522, portal: 172.16.0.220,3260] successful.
Aug 26 15:40:10 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914df318-6b98-4f7b-82e0-73bce4736522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ce11dd-a0e6-4a28-a21f-35c9f644eb60]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] <== disconnect_volume: return (316ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:40:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Deleting instance files /opt/stack/data/nova/instances/c2d1ac95-9da9-435e-852a-60e983466abe_del
Aug 26 15:40:10 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Deletion of /opt/stack/data/nova/instances/c2d1ac95-9da9-435e-852a-60e983466abe_del complete
Aug 26 15:40:10 user nova-compute[73052]: INFO nova.compute.manager [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 26 15:40:10 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:40:10 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:40:10 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Took 0.50 seconds to deallocate network for instance.
Aug 26 15:40:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:11 user nova-compute[73052]: INFO nova.compute.manager [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Took 0.76 seconds to detach 1 volumes for instance.
Aug 26 15:40:11 user nova-compute[73052]: DEBUG nova.compute.manager [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Deleting volume: 914df318-6b98-4f7b-82e0-73bce4736522 {{(pid=73052) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-67e3c0c2-6393-4866-8cd0-c649d97ad798 req-59ec0536-3b1b-4092-8a4a-b89105d588ef service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-67e3c0c2-6393-4866-8cd0-c649d97ad798 req-59ec0536-3b1b-4092-8a4a-b89105d588ef service nova] Acquiring lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-67e3c0c2-6393-4866-8cd0-c649d97ad798 req-59ec0536-3b1b-4092-8a4a-b89105d588ef service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-67e3c0c2-6393-4866-8cd0-c649d97ad798 req-59ec0536-3b1b-4092-8a4a-b89105d588ef service nova] Lock "c2d1ac95-9da9-435e-852a-60e983466abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-67e3c0c2-6393-4866-8cd0-c649d97ad798 req-59ec0536-3b1b-4092-8a4a-b89105d588ef service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] No waiting events found dispatching network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:40:11 user nova-compute[73052]: WARNING nova.compute.manager [req-67e3c0c2-6393-4866-8cd0-c649d97ad798 req-59ec0536-3b1b-4092-8a4a-b89105d588ef service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received unexpected event network-vif-plugged-eebb8615-5e1f-4259-b5fa-8d783270aa9c for instance with vm_state active and task_state deleting.
Aug 26 15:40:11 user nova-compute[73052]: DEBUG nova.compute.manager [req-67e3c0c2-6393-4866-8cd0-c649d97ad798 req-59ec0536-3b1b-4092-8a4a-b89105d588ef service nova] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Received event network-vif-deleted-eebb8615-5e1f-4259-b5fa-8d783270aa9c {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:40:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:40:11 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Deleted allocations for instance c2d1ac95-9da9-435e-852a-60e983466abe
Aug 26 15:40:11 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-24683522-c837-4e31-aeac-453a549c41b3 tempest-TestShelveInstance-1968753790 tempest-TestShelveInstance-1968753790-project-member] Lock "c2d1ac95-9da9-435e-852a-60e983466abe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.880s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:40:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:40:24 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693064409.7611, c2d1ac95-9da9-435e-852a-60e983466abe => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:40:24 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] VM Stopped (Lifecycle Event)
Aug 26 15:40:24 user nova-compute[73052]: DEBUG nova.compute.manager [None req-3c819810-df0d-4484-a185-f73ab7d39291 None None] [instance: c2d1ac95-9da9-435e-852a-60e983466abe] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:40:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:40:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:40:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:40:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:40:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:40:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:40:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:40:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:40:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:43 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:43 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:40:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:40:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:40:47 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:40:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:54 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:54 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:40:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:40:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:40:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:40:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:40:54 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:40:55 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:40:55 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:40:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.100875854492188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:40:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:40:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:40:55 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:40:55 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:40:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:40:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:40:59 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:03 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:09 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:14 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:19 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:41:24 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:41:29 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:33 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:39 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:42 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:42 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:41:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:44 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:47 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:41:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:41:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:41:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Starting instance... {{(pid=73052) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73052) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 15:41:49 user nova-compute[73052]: INFO nova.compute.claims [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Claim successful on node user
Aug 26 15:41:49 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Start building networks asynchronously for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Allocating IP information in the background. {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] allocate_for_instance() {{(pid=73052) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 15:41:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 15:41:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Start building block device mappings for instance. {{(pid=73052) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG nova.policy [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ee0e1f2cb064a2b86b4bdc980e6be84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d1b84d274d259f728c84feadd216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73052) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Start spawning the instance on the hypervisor. {{(pid=73052) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Creating instance directory {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 15:41:50 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Creating image(s)
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "/opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "/opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.216s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.256s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk 1073741824 {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a,backing_fmt=raw /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk 1073741824" returned: 0 in 0.071s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "8f5144fad31c750b6b0f8224f385840c9ef37d3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:50 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5144fad31c750b6b0f8224f385840c9ef37d3a --force-share --output=json" returned: 0 in 0.205s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk. size=1073741824 {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Successfully created port: 2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG nova.virt.disk.api [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Cannot resize image /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk to a smaller size. {{(pid=73052) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Created local disks {{(pid=73052) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Ensure instance console log exists: /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/console.log {{(pid=73052) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Successfully updated port: 2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Building network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-14e7ab60-91af-41d1-b791-8d6f9501aa96 req-5f1723c1-d811-455f-a768-78d0c3179882 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received event network-changed-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [req-14e7ab60-91af-41d1-b791-8d6f9501aa96 req-5f1723c1-d811-455f-a768-78d0c3179882 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Refreshing instance network info cache due to event network-changed-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-14e7ab60-91af-41d1-b791-8d6f9501aa96 req-5f1723c1-d811-455f-a768-78d0c3179882 service nova] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Instance cache missing network info. {{(pid=73052) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Instance network_info: |[{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73052) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-14e7ab60-91af-41d1-b791-8d6f9501aa96 req-5f1723c1-d811-455f-a768-78d0c3179882 service nova] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-14e7ab60-91af-41d1-b791-8d6f9501aa96 req-5f1723c1-d811-455f-a768-78d0c3179882 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Refreshing network info cache for port 2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Start _get_guest_xml network_info=[{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'image_id': 'a9d03ca9-51ef-4843-bf03-544c5298003b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 15:41:52 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:41:52 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] CPU controller missing on host. {{(pid=73052) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.host [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] CPU controller found on host. {{(pid=73052) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73052) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T14:36:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T14:36:15Z,direct_url=<?>,disk_format='qcow2',id=a9d03ca9-51ef-4843-bf03-544c5298003b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e028da825034e66a38c96828c9fe4b6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T14:36:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Flavor limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Image limits 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Flavor pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Image pref 0:0:0 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Got 1 possible topologies {{(pid=73052) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.hardware [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73052) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1650004128',display_name='tempest-SnapshotDataIntegrityTests-server-1650004128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1650004128',id=53,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNR6b9pBiIi2LkZBUtdDJbqQlRhD5CpAwjxfaIc60LwjPEh1aUVToqal8q1T6KlB2soSULoYJfmOX7JmPcq0tm5qCuhlMJl6Ypa4pCbn+riAcXdHGVVrcpDLvglIBDNeA==',key_name='tempest-keypair-214532553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f426d1b84d274d259f728c84feadd216',ramdisk_id='',reservation_id='r-49w64h6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1008585035',owner_user_name='tempest-SnapshotDataIntegrityTests-1008585035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:41:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee0e1f2cb064a2b86b4bdc980e6be84',uuid=a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73052) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Converting VIF {"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:32:7c,bridge_name='br-int',has_traffic_filtering=True,id=2c1d5d1c-9567-44e0-9f69-d48cab9f40e8,network=Network(0dab3b6e-9656-4606-ac13-2482b41adfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d5d1c-95') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'pci_devices' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 15:41:52 user nova-compute[73052]:   <uuid>a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0</uuid>
Aug 26 15:41:52 user nova-compute[73052]:   <name>instance-00000035</name>
Aug 26 15:41:52 user nova-compute[73052]:   <memory>524288</memory>
Aug 26 15:41:52 user nova-compute[73052]:   <vcpu>1</vcpu>
Aug 26 15:41:52 user nova-compute[73052]:   <metadata>
Aug 26 15:41:52 user nova-compute[73052]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 15:41:52 user nova-compute[73052]:       <nova:package version="0.0.0"/>
Aug 26 15:41:52 user nova-compute[73052]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1650004128</nova:name>
Aug 26 15:41:52 user nova-compute[73052]:       <nova:creationTime>2023-08-26 15:41:52</nova:creationTime>
Aug 26 15:41:52 user nova-compute[73052]:       <nova:flavor name="m1.tiny">
Aug 26 15:41:52 user nova-compute[73052]:         <nova:memory>512</nova:memory>
Aug 26 15:41:52 user nova-compute[73052]:         <nova:disk>1</nova:disk>
Aug 26 15:41:52 user nova-compute[73052]:         <nova:swap>0</nova:swap>
Aug 26 15:41:52 user nova-compute[73052]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 15:41:52 user nova-compute[73052]:         <nova:vcpus>1</nova:vcpus>
Aug 26 15:41:52 user nova-compute[73052]:       </nova:flavor>
Aug 26 15:41:52 user nova-compute[73052]:       <nova:owner>
Aug 26 15:41:52 user nova-compute[73052]:         <nova:user uuid="0ee0e1f2cb064a2b86b4bdc980e6be84">tempest-SnapshotDataIntegrityTests-1008585035-project-member</nova:user>
Aug 26 15:41:52 user nova-compute[73052]:         <nova:project uuid="f426d1b84d274d259f728c84feadd216">tempest-SnapshotDataIntegrityTests-1008585035</nova:project>
Aug 26 15:41:52 user nova-compute[73052]:       </nova:owner>
Aug 26 15:41:52 user nova-compute[73052]:       <nova:root type="image" uuid="a9d03ca9-51ef-4843-bf03-544c5298003b"/>
Aug 26 15:41:52 user nova-compute[73052]:       <nova:ports>
Aug 26 15:41:52 user nova-compute[73052]:         <nova:port uuid="2c1d5d1c-9567-44e0-9f69-d48cab9f40e8">
Aug 26 15:41:52 user nova-compute[73052]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 15:41:52 user nova-compute[73052]:         </nova:port>
Aug 26 15:41:52 user nova-compute[73052]:       </nova:ports>
Aug 26 15:41:52 user nova-compute[73052]:     </nova:instance>
Aug 26 15:41:52 user nova-compute[73052]:   </metadata>
Aug 26 15:41:52 user nova-compute[73052]:   <sysinfo type="smbios">
Aug 26 15:41:52 user nova-compute[73052]:     <system>
Aug 26 15:41:52 user nova-compute[73052]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 15:41:52 user nova-compute[73052]:       <entry name="product">OpenStack Nova</entry>
Aug 26 15:41:52 user nova-compute[73052]:       <entry name="version">0.0.0</entry>
Aug 26 15:41:52 user nova-compute[73052]:       <entry name="serial">a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0</entry>
Aug 26 15:41:52 user nova-compute[73052]:       <entry name="uuid">a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0</entry>
Aug 26 15:41:52 user nova-compute[73052]:       <entry name="family">Virtual Machine</entry>
Aug 26 15:41:52 user nova-compute[73052]:     </system>
Aug 26 15:41:52 user nova-compute[73052]:   </sysinfo>
Aug 26 15:41:52 user nova-compute[73052]:   <os>
Aug 26 15:41:52 user nova-compute[73052]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 15:41:52 user nova-compute[73052]:     <boot dev="hd"/>
Aug 26 15:41:52 user nova-compute[73052]:     <smbios mode="sysinfo"/>
Aug 26 15:41:52 user nova-compute[73052]:   </os>
Aug 26 15:41:52 user nova-compute[73052]:   <features>
Aug 26 15:41:52 user nova-compute[73052]:     <acpi/>
Aug 26 15:41:52 user nova-compute[73052]:     <apic/>
Aug 26 15:41:52 user nova-compute[73052]:     <vmcoreinfo/>
Aug 26 15:41:52 user nova-compute[73052]:   </features>
Aug 26 15:41:52 user nova-compute[73052]:   <clock offset="utc">
Aug 26 15:41:52 user nova-compute[73052]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 15:41:52 user nova-compute[73052]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 15:41:52 user nova-compute[73052]:     <timer name="hpet" present="no"/>
Aug 26 15:41:52 user nova-compute[73052]:   </clock>
Aug 26 15:41:52 user nova-compute[73052]:   <cpu mode="custom" match="exact">
Aug 26 15:41:52 user nova-compute[73052]:     <model>Nehalem</model>
Aug 26 15:41:52 user nova-compute[73052]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 15:41:52 user nova-compute[73052]:   </cpu>
Aug 26 15:41:52 user nova-compute[73052]:   <devices>
Aug 26 15:41:52 user nova-compute[73052]:     <disk type="file" device="disk">
Aug 26 15:41:52 user nova-compute[73052]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 15:41:52 user nova-compute[73052]:       <source file="/opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk"/>
Aug 26 15:41:52 user nova-compute[73052]:       <target dev="vda" bus="virtio"/>
Aug 26 15:41:52 user nova-compute[73052]:     </disk>
Aug 26 15:41:52 user nova-compute[73052]:     <interface type="ethernet">
Aug 26 15:41:52 user nova-compute[73052]:       <mac address="fa:16:3e:f0:32:7c"/>
Aug 26 15:41:52 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:41:52 user nova-compute[73052]:       <mtu size="1442"/>
Aug 26 15:41:52 user nova-compute[73052]:       <target dev="tap2c1d5d1c-95"/>
Aug 26 15:41:52 user nova-compute[73052]:     </interface>
Aug 26 15:41:52 user nova-compute[73052]:     <serial type="pty">
Aug 26 15:41:52 user nova-compute[73052]:       <log file="/opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/console.log" append="off"/>
Aug 26 15:41:52 user nova-compute[73052]:     </serial>
Aug 26 15:41:52 user nova-compute[73052]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 15:41:52 user nova-compute[73052]:     <video>
Aug 26 15:41:52 user nova-compute[73052]:       <model type="virtio"/>
Aug 26 15:41:52 user nova-compute[73052]:     </video>
Aug 26 15:41:52 user nova-compute[73052]:     <rng model="virtio">
Aug 26 15:41:52 user nova-compute[73052]:       <backend model="random">/dev/urandom</backend>
Aug 26 15:41:52 user nova-compute[73052]:     </rng>
Aug 26 15:41:52 user nova-compute[73052]:     <controller type="usb" index="0" model="none"/>
Aug 26 15:41:52 user nova-compute[73052]:     <memballoon model="virtio">
Aug 26 15:41:52 user nova-compute[73052]:       <stats period="10"/>
Aug 26 15:41:52 user nova-compute[73052]:     </memballoon>
Aug 26 15:41:52 user nova-compute[73052]:   </devices>
Aug 26 15:41:52 user nova-compute[73052]: </domain>
Aug 26 15:41:52 user nova-compute[73052]:  {{(pid=73052) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1650004128',display_name='tempest-SnapshotDataIntegrityTests-server-1650004128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1650004128',id=53,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNR6b9pBiIi2LkZBUtdDJbqQlRhD5CpAwjxfaIc60LwjPEh1aUVToqal8q1T6KlB2soSULoYJfmOX7JmPcq0tm5qCuhlMJl6Ypa4pCbn+riAcXdHGVVrcpDLvglIBDNeA==',key_name='tempest-keypair-214532553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f426d1b84d274d259f728c84feadd216',ramdisk_id='',reservation_id='r-49w64h6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1008585035',owner_user_name='tempest-SnapshotDataIntegrityTests-1008585035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T15:41:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee0e1f2cb064a2b86b4bdc980e6be84',uuid=a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Converting VIF {"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:32:7c,bridge_name='br-int',has_traffic_filtering=True,id=2c1d5d1c-9567-44e0-9f69-d48cab9f40e8,network=Network(0dab3b6e-9656-4606-ac13-2482b41adfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d5d1c-95') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG os_vif [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:32:7c,bridge_name='br-int',has_traffic_filtering=True,id=2c1d5d1c-9567-44e0-9f69-d48cab9f40e8,network=Network(0dab3b6e-9656-4606-ac13-2482b41adfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d5d1c-95') {{(pid=73052) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c1d5d1c-95, may_exist=True, interface_attrs={}) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c1d5d1c-95, col_values=(('external_ids', {'iface-id': '2c1d5d1c-9567-44e0-9f69-d48cab9f40e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:32:7c', 'vm-uuid': 'a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0'}),), if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:52 user nova-compute[73052]: INFO os_vif [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:32:7c,bridge_name='br-int',has_traffic_filtering=True,id=2c1d5d1c-9567-44e0-9f69-d48cab9f40e8,network=Network(0dab3b6e-9656-4606-ac13-2482b41adfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d5d1c-95')
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No VIF found with MAC fa:16:3e:f0:32:7c, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-14e7ab60-91af-41d1-b791-8d6f9501aa96 req-5f1723c1-d811-455f-a768-78d0c3179882 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated VIF entry in instance network info cache for port 2c1d5d1c-9567-44e0-9f69-d48cab9f40e8. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:41:52 user nova-compute[73052]: DEBUG nova.network.neutron [req-14e7ab60-91af-41d1-b791-8d6f9501aa96 req-5f1723c1-d811-455f-a768-78d0c3179882 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:41:53 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-14e7ab60-91af-41d1-b791-8d6f9501aa96 req-5f1723c1-d811-455f-a768-78d0c3179882 service nova] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:41:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:53 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-fc74d481-4752-4e8c-ac6c-8cd5c833b509 req-9bfc8610-4673-449d-b520-426e53f1a22a service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received event network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fc74d481-4752-4e8c-ac6c-8cd5c833b509 req-9bfc8610-4673-449d-b520-426e53f1a22a service nova] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fc74d481-4752-4e8c-ac6c-8cd5c833b509 req-9bfc8610-4673-449d-b520-426e53f1a22a service nova] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-fc74d481-4752-4e8c-ac6c-8cd5c833b509 req-9bfc8610-4673-449d-b520-426e53f1a22a service nova] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG nova.compute.manager [req-fc74d481-4752-4e8c-ac6c-8cd5c833b509 req-9bfc8610-4673-449d-b520-426e53f1a22a service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] No waiting events found dispatching network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:41:54 user nova-compute[73052]: WARNING nova.compute.manager [req-fc74d481-4752-4e8c-ac6c-8cd5c833b509 req-9bfc8610-4673-449d-b520-426e53f1a22a service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received unexpected event network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 for instance with vm_state building and task_state spawning.
Aug 26 15:41:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:41:54 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:41:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693064516.4712877, a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 => Resumed> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:41:57 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] VM Resumed (Lifecycle Event)
Aug 26 15:41:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-c8964d5a-c1de-4459-be1b-dcda0ef69e15 req-a27029d9-8198-41ce-b7f4-056e9f347a47 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received event network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c8964d5a-c1de-4459-be1b-dcda0ef69e15 req-a27029d9-8198-41ce-b7f4-056e9f347a47 service nova] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c8964d5a-c1de-4459-be1b-dcda0ef69e15 req-a27029d9-8198-41ce-b7f4-056e9f347a47 service nova] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c8964d5a-c1de-4459-be1b-dcda0ef69e15 req-a27029d9-8198-41ce-b7f4-056e9f347a47 service nova] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [req-c8964d5a-c1de-4459-be1b-dcda0ef69e15 req-a27029d9-8198-41ce-b7f4-056e9f347a47 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] No waiting events found dispatching network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:41:57 user nova-compute[73052]: WARNING nova.compute.manager [req-c8964d5a-c1de-4459-be1b-dcda0ef69e15 req-a27029d9-8198-41ce-b7f4-056e9f347a47 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received unexpected event network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 for instance with vm_state building and task_state spawning.
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Instance event wait completed in 0 seconds for  {{(pid=73052) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Guest created on hypervisor {{(pid=73052) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:41:57 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:41:57 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8601MB free_disk=25.086254119873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:41:57 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Instance spawned successfully.
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:41:57 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Emitting event <LifecycleEvent: 1693064516.4715858, a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 => Started> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:41:57 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] VM Started (Lifecycle Event)
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Found default for hw_cdrom_bus of ide {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Found default for hw_disk_bus of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Found default for hw_input_bus of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Found default for hw_pointer_model of None {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Found default for hw_video_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Found default for hw_vif_model of virtio {{(pid=73052) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73052) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:41:57 user nova-compute[73052]: INFO nova.compute.manager [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:41:57 user nova-compute[73052]: INFO nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:41:57 user nova-compute[73052]: INFO nova.compute.manager [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Took 7.78 seconds to build instance.
Aug 26 15:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-50cae53f-3532-4382-b9e7-13e08b12b971 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.913s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:41:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:41:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:04 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:04 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:42:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:42:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:25 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:27 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:42:27 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:42:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:31 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:44 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:44 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:42:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:42:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:42:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:42:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:42:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:42:48 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:42:48 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:42:49 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:42:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:42:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:42:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:49 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:42:54 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:42:55 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:42:55 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:42:56 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:42:56 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:42:56 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=25.047027587890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:42:56 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:42:57 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:42:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:42:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:42:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:43:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:43:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:43:16 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:43:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:43:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:43:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:43:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:43:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-61d5486f-8bc7-469b-92ae-ef38da107d10 req-cbe7ae76-a396-481c-887b-570813245c48 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received event network-changed-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:43:40 user nova-compute[73052]: DEBUG nova.compute.manager [req-61d5486f-8bc7-469b-92ae-ef38da107d10 req-cbe7ae76-a396-481c-887b-570813245c48 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Refreshing instance network info cache due to event network-changed-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8. {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 15:43:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-61d5486f-8bc7-469b-92ae-ef38da107d10 req-cbe7ae76-a396-481c-887b-570813245c48 service nova] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:43:40 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-61d5486f-8bc7-469b-92ae-ef38da107d10 req-cbe7ae76-a396-481c-887b-570813245c48 service nova] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:43:40 user nova-compute[73052]: DEBUG nova.network.neutron [req-61d5486f-8bc7-469b-92ae-ef38da107d10 req-cbe7ae76-a396-481c-887b-570813245c48 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Refreshing network info cache for port 2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 15:43:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:43:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-61d5486f-8bc7-469b-92ae-ef38da107d10 req-cbe7ae76-a396-481c-887b-570813245c48 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated VIF entry in instance network info cache for port 2c1d5d1c-9567-44e0-9f69-d48cab9f40e8. {{(pid=73052) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 15:43:41 user nova-compute[73052]: DEBUG nova.network.neutron [req-61d5486f-8bc7-469b-92ae-ef38da107d10 req-cbe7ae76-a396-481c-887b-570813245c48 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:43:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-61d5486f-8bc7-469b-92ae-ef38da107d10 req-cbe7ae76-a396-481c-887b-570813245c48 service nova] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:43:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG nova.objects.instance [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:43:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:43:46 user nova-compute[73052]: INFO nova.compute.manager [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attaching volume 830f5251-5db9-4943-b25c-ff11742cc8f3 to /dev/vdb
Aug 26 15:43:47 user nova-compute[73052]: DEBUG os_brick.utils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f813d273-595c-4978-88b3-295174310c5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948cfa2-93bb-4ee1-9cf6-cd8fb5bf31fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e494ac-c29f-4be7-9371-cd088d92b3f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[14818f51-e533-42f6-b52b-0a71c902f98d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:43:47 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:43:47 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[858f545e-281c-406f-8bd0-dc1aa9f26126]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG os_brick.utils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating existing volume attachment record: b63afd65-cd75-436c-93d8-dfcf1a0f1edc {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:43:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:43:48 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:43:48 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:43:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:43:48 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:43:48 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:43:49 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:43:49 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:43:49 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:43:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:43:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:43:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:56 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:43:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVvQIPTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:43:57 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:43:57 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:43:57 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4152184b-fabf-44e2-a8b3-98c89b330672]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:43:57 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c171820-fa10-4d28-8199-6c9bc228aa23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3] added
Aug 26 15:43:57 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ee606b-a471-4c3c-99d1-b7500234c562]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[623d187e-118d-4e5a-9554-04b6167259c3]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVvQIPTG {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVvQIPTG" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce21ea-614a-4d92-864c-3ac54b6e1b05]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HVvQIPTG'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e612998-43dd-496f-aedd-e9eb32de6d6d]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc4ebfa-10d9-4902-8511-1f82c6027672]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:43:57 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:43:57 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:43:57 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:43:57 user nova-compute[73052]: 
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c22df4a-2ed1-4069-83fb-46b888d5e7d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3, portal: 172.16.0.220,3260]
Aug 26 15:43:57 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3, portal: 172.16.0.220,3260] successful.
Aug 26 15:43:57 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[357f5598-b2ef-4940-8019-2077387b6e7f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e93191-9bbf-49fa-9a1b-74791c289741]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 (non-flash)
Aug 26 15:43:57 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 (non-flash)
Aug 26 15:43:57 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:43:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b7f4da-7c22-49df-9f62-ff9f0225c45a]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVvQIPTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:43:58 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:43:58 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:43:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=25.0445556640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:43:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26333626464613136', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333626464613136', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.objects.instance [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:43:59 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:43:59 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:43:59 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:43:59 user nova-compute[73052]:   <serial>830f5251-5db9-4943-b25c-ff11742cc8f3</serial>
Aug 26 15:43:59 user nova-compute[73052]: </disk>
Aug 26 15:43:59 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No VIF found with MAC fa:16:3e:f0:32:7c, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:43:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-3eb52d74-eb05-454a-8f55-d1f55c562e94 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.637s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:44:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:04 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:06 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:11 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:16 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:21 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:44:30 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:44:31 user nova-compute[73052]: INFO nova.compute.manager [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Detaching volume 830f5251-5db9-4943-b25c-ff11742cc8f3
Aug 26 15:44:31 user nova-compute[73052]: INFO nova.virt.block_device [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attempting to driver detach volume 830f5251-5db9-4943-b25c-ff11742cc8f3 from mountpoint /dev/vdb
Aug 26 15:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Attempting to detach device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:44:31 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:44:31 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:44:31 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:44:31 user nova-compute[73052]:   <serial>830f5251-5db9-4943-b25c-ff11742cc8f3</serial>
Aug 26 15:44:31 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:44:31 user nova-compute[73052]: </disk>
Aug 26 15:44:31 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:44:31 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully detached device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the persistent domain config.
Aug 26 15:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:44:31 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:44:31 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:44:31 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:44:31 user nova-compute[73052]:   <serial>830f5251-5db9-4943-b25c-ff11742cc8f3</serial>
Aug 26 15:44:31 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:44:31 user nova-compute[73052]: </disk>
Aug 26 15:44:31 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693064671.5342774, a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:44:31 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully detached device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the live domain config.
Aug 26 15:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVvQIPTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:44:31 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72f707a-d031-4bc8-9d33-4b530a721878]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62fe0be-5036-4d71-a8ed-5c5a794eb868]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 (non-flash)
Aug 26 15:44:31 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 (non-flash)
Aug 26 15:44:31 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f087c7f0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafa0651-00f3-48c2-b5d7-e4a9be5fc151]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b5b039-e92c-4c94-839b-07a2675255e2]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd19232-1ee0-4f4d-9d84-50b740749a98]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c938222-e710-4fb4-9566-6f6e720a29cc]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a3ae1c-151c-4b78-8fdd-d01e79816e7b]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1aaaed-7de8-439a-8ce5-fa6fe5ef0013]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3, portal: 172.16.0.220,3260]
Aug 26 15:44:31 user nova-compute[73052]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3, portal: 172.16.0.220,3260] successful.
Aug 26 15:44:31 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830f5251-5db9-4943-b25c-ff11742cc8f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2d620e-be3e-45d9-87dd-9dc1900b1751]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== disconnect_volume: return (277ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:44:31 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:44:32 user nova-compute[73052]: DEBUG nova.objects.instance [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:44:32 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-b6bc8b8b-b3ec-46e2-b691-47f2c3913d3a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:44:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:44:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:44:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:44:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:44:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:44:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:44:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:44:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:44:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:44:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:44:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:44:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:44:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:44:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:44:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:44:57 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:44:57 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:44:57 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:44:58 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:44:58 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:44:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=25.043315887451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:44:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:44:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:44:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:45:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:18 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:45:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:45:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:45:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:45:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:45:25 user nova-compute[73052]: INFO nova.compute.manager [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attaching volume 1cd020fb-88a0-4f55-afda-38dcb79944f2 to /dev/vdb
Aug 26 15:45:25 user nova-compute[73052]: DEBUG os_brick.utils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4643ff0-5f5a-4d8c-9b6a-cc199e3a1e2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a030e6-162a-4969-b0ff-342cd63f06ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabdba19-869a-4a43-94d6-9a6d5a9c7ab9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b91d22-bb41-4ed6-85a3-02b772a7ab4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:45:25 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:45:25 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0d34c3-d091-48f5-a5a1-00ad58c77825]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG os_brick.utils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:45:25 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating existing volume attachment record: 0d86f1d0-89df-4a33-a481-ad70fb66372c {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:45:26 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYrRCeAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:45:35 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:45:35 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:45:35 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e504a-745d-48f7-8af1-34fb1e968caf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:45:35 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c303dcb-dad7-4ff2-bd9a-68e7f44cc080]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2] added
Aug 26 15:45:35 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c236f1d2-7743-4881-ad4a-a0092e2e4ff2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a0b16e-5758-4583-8cef-9e55291aa5aa]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYrRCeAy {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYrRCeAy" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b74cb-9ee4-4924-95a4-2db48f74332f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYrRCeAy'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fd426e-115d-4e7f-bc75-ea0882787106]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bc0b11-0520-450f-9ee6-062b5d94edb0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:45:35 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:45:35 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:45:35 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:45:35 user nova-compute[73052]: 
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf92df2e-9f81-48db-93c1-9e74364af711]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2, portal: 172.16.0.220,3260]
Aug 26 15:45:35 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2, portal: 172.16.0.220,3260] successful.
Aug 26 15:45:35 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f933aa79-16f5-424c-b8d0-368667aeecfc]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[571e7b4b-004b-4943-b324-37696cef49c3]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 (non-flash)
Aug 26 15:45:35 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 (non-flash)
Aug 26 15:45:35 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc79d3-c34a-44a5-99a8-1ab7272a39d0]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:45:35 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYrRCeAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:45:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:45:36 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23837346135343731', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:45:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837346135343731', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:45:36 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:45:36 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:45:36 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:45:36 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:45:36 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:45:36 user nova-compute[73052]:   <serial>1cd020fb-88a0-4f55-afda-38dcb79944f2</serial>
Aug 26 15:45:36 user nova-compute[73052]: </disk>
Aug 26 15:45:36 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:45:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:45:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:45:37 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No VIF found with MAC fa:16:3e:f0:32:7c, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:45:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c03f7a4d-a5d9-4ba3-b9ca-f3bcf04e8ad2 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.936s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:45:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:45:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:45:39 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:45:39 user nova-compute[73052]: INFO nova.compute.manager [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Detaching volume 1cd020fb-88a0-4f55-afda-38dcb79944f2
Aug 26 15:45:39 user nova-compute[73052]: INFO nova.virt.block_device [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attempting to driver detach volume 1cd020fb-88a0-4f55-afda-38dcb79944f2 from mountpoint /dev/vdb
Aug 26 15:45:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Attempting to detach device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:45:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:45:39 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:45:39 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:45:39 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:45:39 user nova-compute[73052]:   <serial>1cd020fb-88a0-4f55-afda-38dcb79944f2</serial>
Aug 26 15:45:39 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:45:39 user nova-compute[73052]: </disk>
Aug 26 15:45:39 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:45:39 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully detached device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the persistent domain config.
Aug 26 15:45:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:45:39 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:45:39 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:45:39 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:45:39 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:45:39 user nova-compute[73052]:   <serial>1cd020fb-88a0-4f55-afda-38dcb79944f2</serial>
Aug 26 15:45:39 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:45:39 user nova-compute[73052]: </disk>
Aug 26 15:45:39 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693064740.1865587, a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:45:40 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully detached device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the live domain config.
Aug 26 15:45:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYrRCeAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:45:40 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6daadf9-254c-4d60-a522-726a903f987a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f743b9d8-deb2-4d8f-a685-436c0f367d59]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 (non-flash)
Aug 26 15:45:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 (non-flash)
Aug 26 15:45:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01e5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[0600c9c6-2e3e-4635-bdf2-8233cb60af71]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[756cce76-5fb5-49d3-bed6-d6f651e8cc16]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4fcab4-0935-49a0-baf1-2672b32b8582]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd1230b-4b2d-4f91-a98e-9a5c9c86bb5d]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dad116c-be4c-4804-b0f5-080a2c4b6409]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9400d5-be55-495f-92e2-adc0329f279b]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2, portal: 172.16.0.220,3260]
Aug 26 15:45:40 user nova-compute[73052]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2, portal: 172.16.0.220,3260] successful.
Aug 26 15:45:40 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd020fb-88a0-4f55-afda-38dcb79944f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[006725c4-3d1f-4777-8c8a-2c40a0adc154]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== disconnect_volume: return (240ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:45:40 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:45:41 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:41 user nova-compute[73052]: DEBUG nova.objects.instance [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:45:41 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-e2789af2-6c70-4ad1-b9a6-86b4cbe366c0 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:45:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:45:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:45:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:45:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:45:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:45:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:45:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:45:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:45:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:45:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:45:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:45:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:45:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:45:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:45:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:45:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:00 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:46:00 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:46:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=25.04228973388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:46:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:46:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:46:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:46:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:46:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:46:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:46:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:46:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:46:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:46:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG nova.objects.instance [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:46:33 user nova-compute[73052]: INFO nova.compute.manager [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attaching volume da104bf1-135b-482f-b55a-76378ec330e7 to /dev/vdb
Aug 26 15:46:33 user nova-compute[73052]: DEBUG os_brick.utils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c797a24-6460-4e31-b114-ff35c9be2b67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c6eede-39f2-4a41-9332-bd64ee938721]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff54d1a2-e455-4d82-8c59-6ff863400fb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25f1334-6c29-47ec-b193-041c25dee61b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:33 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:46:34 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:46:34 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6448271c-d71a-4922-b662-4a659e5e1676]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG os_brick.utils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:46:34 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating existing volume attachment record: 611bf1d8-2674-4283-ac4b-1b3aa6518f8b {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:46:36 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OISDpebZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:46:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:46:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:46:44 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e5c688-a343-44c7-b7ba-6c88df94301e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:46:44 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[919839ac-1b75-4ae5-bc54-c9ca40fcc0d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7] added
Aug 26 15:46:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca591a4b-2d24-4913-83af-cb1ad81fe992]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[176db7bf-a333-45f2-a646-7cd90c768b08]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OISDpebZ {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OISDpebZ" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f69070-9125-4b17-bedc-90aa10b57734]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OISDpebZ'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ac25c0-6b8c-4729-bb22-bbbb6fc7be8f]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f60ffb-7183-4d48-b9a1-d9cd9abaf990]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:46:44 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:46:44 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:46:44 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:46:44 user nova-compute[73052]: 
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef168b2a-9a02-4bf9-8bc5-9f4909e506a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7, portal: 172.16.0.220,3260]
Aug 26 15:46:44 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7, portal: 172.16.0.220,3260] successful.
Aug 26 15:46:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e47eca-e955-48ac-9955-59399588eb44]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcb32ec-b5c1-4ae9-be78-361192e8c8c2]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 (non-flash)
Aug 26 15:46:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 (non-flash)
Aug 26 15:46:44 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64277b6-791a-4eca-bcbc-cde7e8329ab5]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:46:44 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OISDpebZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:46:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:46:45 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23738393663306134', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:46:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738393663306134', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:46:45 user nova-compute[73052]: DEBUG nova.objects.instance [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:46:45 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:46:45 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:46:45 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:46:45 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:46:45 user nova-compute[73052]:   <serial>da104bf1-135b-482f-b55a-76378ec330e7</serial>
Aug 26 15:46:45 user nova-compute[73052]: </disk>
Aug 26 15:46:45 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:46:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:46:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:46:46 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No VIF found with MAC fa:16:3e:f0:32:7c, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:46:46 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-5c28536c-02f8-4987-90d8-7a50e2af4f93 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.306s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:46:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:46:48 user nova-compute[73052]: INFO nova.compute.manager [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Detaching volume da104bf1-135b-482f-b55a-76378ec330e7
Aug 26 15:46:48 user nova-compute[73052]: INFO nova.virt.block_device [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attempting to driver detach volume da104bf1-135b-482f-b55a-76378ec330e7 from mountpoint /dev/vdb
Aug 26 15:46:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Attempting to detach device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:46:48 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:46:48 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:46:48 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:46:48 user nova-compute[73052]:   <serial>da104bf1-135b-482f-b55a-76378ec330e7</serial>
Aug 26 15:46:48 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:46:48 user nova-compute[73052]: </disk>
Aug 26 15:46:48 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:46:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully detached device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the persistent domain config.
Aug 26 15:46:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:46:48 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:46:48 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:46:48 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:46:48 user nova-compute[73052]:   <serial>da104bf1-135b-482f-b55a-76378ec330e7</serial>
Aug 26 15:46:48 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:46:48 user nova-compute[73052]: </disk>
Aug 26 15:46:48 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693064808.8802204, a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:46:48 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully detached device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the live domain config.
Aug 26 15:46:48 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OISDpebZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:46:48 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7069de1-0ff9-4183-b9d1-2cbf8a7c50ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1984690d-c44e-4fac-9fc9-3b7013a9069a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 (non-flash)
Aug 26 15:46:48 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 (non-flash)
Aug 26 15:46:48 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01e6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4320ba-7441-441a-8714-70b2c6064ea0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d55e2f-329a-4f4d-80a4-2614ae8315d8]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:46:48 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1627b805-5bbe-43f1-8985-41bcc3446cc4]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d98dd0-c316-4539-94b8-bfbae317fa64]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[42947509-4138-4ed8-b8eb-4ca677f755cf]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9712a6a-c11f-4cbc-a09d-3dd47be2f85e]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7, portal: 172.16.0.220,3260]
Aug 26 15:46:49 user nova-compute[73052]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7, portal: 172.16.0.220,3260] successful.
Aug 26 15:46:49 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da104bf1-135b-482f-b55a-76378ec330e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeccf81-9527-4aba-8c79-674ae24220d7]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== disconnect_volume: return (271ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:46:49 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-c4697e2d-1de9-4e57-806b-dbb0e50d6a4e tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:46:50 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:46:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:46:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:46:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:46:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:46:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:54 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:46:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:59 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:46:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:46:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:46:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:46:59 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:46:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:00 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:47:00 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.041336059570312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing inventories for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating ProviderTree inventory for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Updating inventory in ProviderTree for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing aggregate associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, aggregates: None {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 15:47:00 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Refreshing trait associations for resource provider 63e4ae70-0fae-4216-9a6e-92eef5558363, traits: COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=73052) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 15:47:01 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:47:01 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:47:01 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:47:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:47:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:47:03 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:47:09 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:09 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73052) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 15:47:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:47:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:47:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:47:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:47:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:47:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:23 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:32 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Cleaning up deleted instances {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 15:47:32 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] There are 0 instances to clean {{(pid=73052) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 15:47:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:37 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG nova.objects.instance [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:47:43 user nova-compute[73052]: INFO nova.compute.manager [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attaching volume 017b7816-0590-456b-a8d8-5d68fff32d5c to /dev/vdb
Aug 26 15:47:43 user nova-compute[73052]: DEBUG os_brick.utils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[740dd005-7d61-41aa-a593-ebe8002f1c7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:214c4e74c9a\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4d5f30-baac-4d39-8b4a-2606a6226714]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc447a3-6a86-4d50-86ff-963658490bc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3816fb1d-ba15-4014-9cd5-a0c1a38077d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Running cmd (subprocess): nvme version {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] 'nvme version' failed. Not Retrying. {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] nvme not present on system {{(pid=73052) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 15:47:43 user nova-compute[73052]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 15:47:43 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd6c730-5eee-45a3-8260-b88667826f9d]: (4, '') {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73052) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.lightos [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] LIGHTOS: no hostnqn found. {{(pid=73052) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG os_brick.utils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:214c4e74c9a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:47:43 user nova-compute[73052]: DEBUG nova.virt.block_device [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating existing volume attachment record: 35bf0905-6b2d-4127-9a7f-5e6bceb44da3 {{(pid=73052) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 15:47:46 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:51 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:47:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:47:51 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:47:51 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:47:51 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:47:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:47:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:47:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:47:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:47:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Calling os-brick to attach iSCSI Volume {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKRcMPJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:47:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:47:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:47:54 user nova-compute[73052]: INFO os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[189102e3-e34c-48fc-bca2-a8648d6ca32e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 15:47:54 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --interface default --op new {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0753ae-3ad5-4c0e-9bf7-5c6c92a38d22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c] added\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c] added
Aug 26 15:47:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e83ca-fb4c-4490-a53f-ebfffaa8cb17]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f696d130-a3cb-4161-8a22-6f5cdb7f7386]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKRcMPJf {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKRcMPJf" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e40598-5995-426e-b683-83cc8c26aec2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EKRcMPJf'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7460c18-8917-4060-a7e5-81e58ef328f2]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff13a40-8dad-4b30-94ca-62c2daed8fdb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:47:54 user nova-compute[73052]:  {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 15:47:54 user nova-compute[73052]:  {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:47:54 user nova-compute[73052]: WARNING os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 15:47:54 user nova-compute[73052]: 
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --login {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8cd1f5-0fab-4a11-8112-3f867aba5bb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c, portal: 172.16.0.220,3260]
Aug 26 15:47:54 user nova-compute[73052]: Login to [iface: default, target: iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c, portal: 172.16.0.220,3260] successful.
Aug 26 15:47:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f64102a-d1ee-4a8e-a267-7248c52ac968]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6337731-d3f3-4edd-b6f5-221d0a34661e]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c (non-flash)
Aug 26 15:47:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c (non-flash)
Aug 26 15:47:54 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Connected to 172.16.0.220:3260 {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73052) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73052) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[3254b4b7-aa13-4d70-9042-84c3c8a59efb]: (4, ('- - 0', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73052) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 15:47:54 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKRcMPJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73052) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26165303335386537', 'path': '/dev/sdb'} {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165303335386537', 'path': '/dev/sdb'} {{(pid=73052) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG nova.objects.instance [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 15:47:55 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:47:55 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:47:55 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:47:55 user nova-compute[73052]:   <serial>017b7816-0590-456b-a8d8-5d68fff32d5c</serial>
Aug 26 15:47:55 user nova-compute[73052]: </disk>
Aug 26 15:47:55 user nova-compute[73052]:  {{(pid=73052) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73052) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] No VIF found with MAC fa:16:3e:f0:32:7c, not building metadata {{(pid=73052) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:55 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-72d3e90c-6c94-4e07-8d96-55443e187910 tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.320s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:47:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:47:58 user nova-compute[73052]: INFO nova.compute.manager [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Detaching volume 017b7816-0590-456b-a8d8-5d68fff32d5c
Aug 26 15:47:58 user nova-compute[73052]: INFO nova.virt.block_device [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Attempting to driver detach volume 017b7816-0590-456b-a8d8-5d68fff32d5c from mountpoint /dev/vdb
Aug 26 15:47:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Attempting to detach device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the persistent domain config. {{(pid=73052) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:47:58 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:47:58 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:47:58 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:47:58 user nova-compute[73052]:   <serial>017b7816-0590-456b-a8d8-5d68fff32d5c</serial>
Aug 26 15:47:58 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:47:58 user nova-compute[73052]: </disk>
Aug 26 15:47:58 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:47:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully detached device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the persistent domain config.
Aug 26 15:47:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the live domain config. {{(pid=73052) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.guest [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 15:47:58 user nova-compute[73052]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 15:47:58 user nova-compute[73052]:   <source dev="/dev/sdb"/>
Aug 26 15:47:58 user nova-compute[73052]:   <target dev="vdb" bus="virtio"/>
Aug 26 15:47:58 user nova-compute[73052]:   <serial>017b7816-0590-456b-a8d8-5d68fff32d5c</serial>
Aug 26 15:47:58 user nova-compute[73052]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 15:47:58 user nova-compute[73052]: </disk>
Aug 26 15:47:58 user nova-compute[73052]:  {{(pid=73052) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-1ad5679a-25af-4a97-b202-5dd390727eca None None] Received event <DeviceRemovedEvent: 1693064878.7350094, a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73052) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.driver [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 15:47:58 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully detached device vdb from instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 from the live domain config.
Aug 26 15:47:58 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] calling os-brick to detach iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f08a0613070>, {'target_iqns': ['iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKRcMPJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 15:47:58 user nova-compute[73052]: WARNING os_brick.initiator.connectors.base [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c', 0)] {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a3e4f-cd8d-4fd6-918c-c126c9c134c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26c1b12-ca59-47be-ae7f-dbd3b32eb997]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c (non-flash)\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c (non-flash)
Aug 26 15:47:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c (non-flash)
Aug 26 15:47:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f08a01e4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c'): ({'sdb'}, set())}) {{(pid=73052) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Removing single pathed devices sdb {{(pid=73052) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8293e09-f523-41d4-934d-73865dc40981]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b123f1f-36ef-45ed-9797-39d4022eb9be]: (4, ('ok\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Flushing IO for device /dev/sdb {{(pid=73052) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[a382b53c-6169-42d8-a89c-9a586c4ca0fd]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73052) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b7fac6-3880-441b-a43a-d50d743c8be1]: (4, ('1', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.linuxscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] SCSI volumes sdb have been removed. {{(pid=73052) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c')] {{(pid=73052) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aae5983-2831-4761-bd46-19ae2af34349]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --logout {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe404277-f168-4823-9280-5071dd6fc9c8]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c, portal: 172.16.0.220,3260]
Aug 26 15:47:58 user nova-compute[73052]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c, portal: 172.16.0.220,3260] successful.
Aug 26 15:47:58 user nova-compute[73052]:  stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:58 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op delete {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:47:59 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017b7816-0590-456b-a8d8-5d68fff32d5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.068s {{(pid=84351) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:47:59 user nova-compute[73052]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7943b78-e4a3-497e-9a67-4e030fef43ce]: (4, ('', '')) {{(pid=84351) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 15:47:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73052) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 15:47:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.base [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 15:47:59 user nova-compute[73052]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] <== disconnect_volume: return (291ms) None {{(pid=73052) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 15:47:59 user nova-compute[73052]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Disconnected iSCSI Volume {{(pid=73052) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 15:47:59 user nova-compute[73052]: DEBUG nova.objects.instance [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'flavor' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:47:59 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-26b563e0-5aa6-44a6-a326-f0a9cb23179b tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.576s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:48:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:48:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:48:00 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:48:00 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:48:00 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:01 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:48:01 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:48:01 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.040332794189453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:48:01 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:48:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:05 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:14 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:14 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Triggering sync for uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 15:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:48:14 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:48:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:48:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:48:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:48:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:48:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:48:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:48:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:48:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:48:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:37 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:42 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:47 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:48:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:48:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquired lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Forcefully refreshing network info cache for instance {{(pid=73052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG nova.objects.instance [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lazy-loading 'info_cache' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG nova.network.neutron [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [{"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Releasing lock "refresh_cache-a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" {{(pid=73052) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updated the network info_cache for instance {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:48:52 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:55 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:57 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:48:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:48:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:01 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:49:02 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 15:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.processutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73052) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 15:49:03 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:49:03 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:49:03 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=25.039546966552734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:49:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:49:04 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73052) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 15:49:04 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:49:04 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:49:04 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:49:04 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:49:04 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:49:04 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:49:06 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:07 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4988-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:49:12 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:49:17 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:22 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:26 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:49:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:49:34 user nova-compute[73052]: INFO nova.compute.manager [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Terminating instance
Aug 26 15:49:34 user nova-compute[73052]: DEBUG nova.compute.manager [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Start destroying the instance on the hypervisor. {{(pid=73052) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:34 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-c9a948ae-b473-43f2-9d09-75036fc099a0 req-0318e05b-6f7e-40a0-bde1-7b95f1b83153 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received event network-vif-unplugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c9a948ae-b473-43f2-9d09-75036fc099a0 req-0318e05b-6f7e-40a0-bde1-7b95f1b83153 service nova] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c9a948ae-b473-43f2-9d09-75036fc099a0 req-0318e05b-6f7e-40a0-bde1-7b95f1b83153 service nova] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-c9a948ae-b473-43f2-9d09-75036fc099a0 req-0318e05b-6f7e-40a0-bde1-7b95f1b83153 service nova] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-c9a948ae-b473-43f2-9d09-75036fc099a0 req-0318e05b-6f7e-40a0-bde1-7b95f1b83153 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] No waiting events found dispatching network-vif-unplugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [req-c9a948ae-b473-43f2-9d09-75036fc099a0 req-0318e05b-6f7e-40a0-bde1-7b95f1b83153 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received event network-vif-unplugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 for instance with task_state deleting. {{(pid=73052) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [-] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Instance destroyed successfully.
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.objects.instance [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lazy-loading 'resources' on Instance uuid a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 {{(pid=73052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.virt.libvirt.vif [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T15:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1650004128',display_name='tempest-SnapshotDataIntegrityTests-server-1650004128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1650004128',id=53,image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNR6b9pBiIi2LkZBUtdDJbqQlRhD5CpAwjxfaIc60LwjPEh1aUVToqal8q1T6KlB2soSULoYJfmOX7JmPcq0tm5qCuhlMJl6Ypa4pCbn+riAcXdHGVVrcpDLvglIBDNeA==',key_name='tempest-keypair-214532553',keypairs=<?>,launch_index=0,launched_at=2023-08-26T15:41:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f426d1b84d274d259f728c84feadd216',ramdisk_id='',reservation_id='r-49w64h6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9d03ca9-51ef-4843-bf03-544c5298003b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1008585035',owner_user_name='tempest-SnapshotDataIntegrityTests-1008585035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T15:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee0e1f2cb064a2b86b4bdc980e6be84',uuid=a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Converting VIF {"id": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "address": "fa:16:3e:f0:32:7c", "network": {"id": "0dab3b6e-9656-4606-ac13-2482b41adfd1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2141205810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f426d1b84d274d259f728c84feadd216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d5d1c-95", "ovs_interfaceid": "2c1d5d1c-9567-44e0-9f69-d48cab9f40e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.network.os_vif_util [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:32:7c,bridge_name='br-int',has_traffic_filtering=True,id=2c1d5d1c-9567-44e0-9f69-d48cab9f40e8,network=Network(0dab3b6e-9656-4606-ac13-2482b41adfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d5d1c-95') {{(pid=73052) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG os_vif [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:32:7c,bridge_name='br-int',has_traffic_filtering=True,id=2c1d5d1c-9567-44e0-9f69-d48cab9f40e8,network=Network(0dab3b6e-9656-4606-ac13-2482b41adfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d5d1c-95') {{(pid=73052) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c1d5d1c-95, bridge=br-int, if_exists=True) {{(pid=73052) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:49:35 user nova-compute[73052]: INFO os_vif [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:32:7c,bridge_name='br-int',has_traffic_filtering=True,id=2c1d5d1c-9567-44e0-9f69-d48cab9f40e8,network=Network(0dab3b6e-9656-4606-ac13-2482b41adfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d5d1c-95')
Aug 26 15:49:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Deleting instance files /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0_del
Aug 26 15:49:35 user nova-compute[73052]: INFO nova.virt.libvirt.driver [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Deletion of /opt/stack/data/nova/instances/a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0_del complete
Aug 26 15:49:35 user nova-compute[73052]: INFO nova.compute.manager [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 15:49:35 user nova-compute[73052]: DEBUG oslo.service.loopingcall [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73052) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.compute.manager [-] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Deallocating network for instance {{(pid=73052) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 15:49:35 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] deallocate_for_instance() {{(pid=73052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 15:49:36 user nova-compute[73052]: DEBUG nova.network.neutron [-] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Updating instance_info_cache with network_info: [] {{(pid=73052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 15:49:36 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Took 0.93 seconds to deallocate network for instance.
Aug 26 15:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:49:36 user nova-compute[73052]: DEBUG nova.compute.manager [req-55deac40-0fbb-4d51-9d03-9102424ebe16 req-c7aef833-56c8-45ee-bf1d-ff0b1d0d71dc service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received event network-vif-deleted-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:49:36 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:49:36 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:49:36 user nova-compute[73052]: INFO nova.scheduler.client.report [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Deleted allocations for instance a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0
Aug 26 15:49:36 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-319d3977-c707-484e-8ec0-cd93dffd9a2a tempest-SnapshotDataIntegrityTests-1008585035 tempest-SnapshotDataIntegrityTests-1008585035-project-member] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.166s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:49:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-885585b4-51f9-4c73-87dc-e5ab3956a05c req-80d455f7-b0a8-43de-a04d-e5db2ae417d2 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received event network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 15:49:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-885585b4-51f9-4c73-87dc-e5ab3956a05c req-80d455f7-b0a8-43de-a04d-e5db2ae417d2 service nova] Acquiring lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:49:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-885585b4-51f9-4c73-87dc-e5ab3956a05c req-80d455f7-b0a8-43de-a04d-e5db2ae417d2 service nova] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:49:37 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [req-885585b4-51f9-4c73-87dc-e5ab3956a05c req-80d455f7-b0a8-43de-a04d-e5db2ae417d2 service nova] Lock "a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:49:37 user nova-compute[73052]: DEBUG nova.compute.manager [req-885585b4-51f9-4c73-87dc-e5ab3956a05c req-80d455f7-b0a8-43de-a04d-e5db2ae417d2 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] No waiting events found dispatching network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 {{(pid=73052) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 15:49:37 user nova-compute[73052]: WARNING nova.compute.manager [req-885585b4-51f9-4c73-87dc-e5ab3956a05c req-80d455f7-b0a8-43de-a04d-e5db2ae417d2 service nova] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Received unexpected event network-vif-plugged-2c1d5d1c-9567-44e0-9f69-d48cab9f40e8 for instance with vm_state deleted and task_state None.
Aug 26 15:49:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:50 user nova-compute[73052]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693064975.4709082, a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0 => Stopped> {{(pid=73052) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 15:49:50 user nova-compute[73052]: INFO nova.compute.manager [-] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] VM Stopped (Lifecycle Event)
Aug 26 15:49:50 user nova-compute[73052]: DEBUG nova.compute.manager [None req-981ac327-0566-4e39-b46c-79bea9163f57 None None] [instance: a9a6b4e5-4d38-452d-8ac4-7f6c3abc43f0] Checking state {{(pid=73052) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 15:49:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:49:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:49:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:49:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:49:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:49:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:49:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:49:51 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:51 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 15:49:55 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:49:56 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:57 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:49:58 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:50:00 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:00 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:50:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:50:02 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:50:02 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:50:02 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Auditing locally available compute resources for user (node: user) {{(pid=73052) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 15:50:03 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:50:03 user nova-compute[73052]: WARNING nova.virt.libvirt.driver [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 15:50:03 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.06676483154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73052) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 15:50:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 15:50:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 15:50:03 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 15:50:03 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73052) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 15:50:03 user nova-compute[73052]: DEBUG nova.compute.provider_tree [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed in ProviderTree for provider: 63e4ae70-0fae-4216-9a6e-92eef5558363 {{(pid=73052) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 15:50:03 user nova-compute[73052]: DEBUG nova.scheduler.client.report [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Inventory has not changed for provider 63e4ae70-0fae-4216-9a6e-92eef5558363 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73052) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 15:50:03 user nova-compute[73052]: DEBUG nova.compute.resource_tracker [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Compute_service record updated for user:user {{(pid=73052) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 15:50:03 user nova-compute[73052]: DEBUG oslo_concurrency.lockutils [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=73052) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 15:50:05 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:50:07 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:50:10 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:50:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:50:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:50:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:50:15 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:20 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:50:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 15:50:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73052) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 15:50:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:50:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73052) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 15:50:25 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:27 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:28 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:30 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:32 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:35 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:40 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:45 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:50 user nova-compute[73052]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73052) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 15:50:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:50:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Starting heal instance info cache {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 15:50:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Rebuilding the list of instances to heal {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 15:50:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Didn't find any instances for network info cache update. {{(pid=73052) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 15:50:53 user nova-compute[73052]: DEBUG oslo_service.periodic_task [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73052) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 15:50:53 user nova-compute[73052]: DEBUG nova.compute.manager [None req-834f89d0-13c2-4489-9ff3-aca44fe7819c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73052) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}